org.apache.beam.runners.dataflow.util

Class MonitoringUtil

java.lang.Object

org.apache.beam.runners.dataflow.util.MonitoringUtil

public class MonitoringUtil
extends Object

A helper class for monitoring jobs submitted to the service.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	MonitoringUtil.JobMessagesHandler An interface that can be used for defining callbacks to receive a list of JobMessages containing monitoring information.
static class	MonitoringUtil.LoggingHandler A handler that logs monitoring messages.
static class	MonitoringUtil.TimeStampComparator Comparator for sorting rows in increasing order based on timestamp.

Constructor Summary

Constructors

Constructor and Description
MonitoringUtil(DataflowClient dataflowClient) Construct a helper for monitoring.

Method Summary

Modifier and Type	Method and Description
static String	getGcloudCancelCommand(DataflowPipelineOptions options, String jobId)
List<com.google.api.services.dataflow.model.JobMessage>	getJobMessages(String jobId, long startTimestampMs) Return job messages sorted in ascending order by timestamp.
static String	getJobMonitoringPageURL(String projectName, String jobId) Deprecated. this method defaults the region to "us-central1". Prefer using the overload with an explicit regionId parameter.
static String	getJobMonitoringPageURL(String projectName, String regionId, String jobId)
static PipelineResult.State	toState(String stateName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MonitoringUtil

public MonitoringUtil(DataflowClient dataflowClient)

Construct a helper for monitoring.

Method Detail

getJobMessages

public List<com.google.api.services.dataflow.model.JobMessage> getJobMessages(String jobId,
                                                                              long startTimestampMs)
                                                                       throws IOException

Return job messages sorted in ascending order by timestamp.

Parameters:

jobId - The id of the job to get the messages for.

startTimestampMs - Return only those messages with a timestamp greater than this value.

Returns:

collection of messages

Throws:

IOException

getJobMonitoringPageURL

@Deprecated
public static String getJobMonitoringPageURL(String projectName,
                                                         String jobId)

Deprecated. this method defaults the region to "us-central1". Prefer using the overload with an explicit regionId parameter.

getJobMonitoringPageURL

public static String getJobMonitoringPageURL(String projectName,
                                             String regionId,
                                             String jobId)

getGcloudCancelCommand

public static String getGcloudCancelCommand(DataflowPipelineOptions options,
                                            String jobId)

toState

public static PipelineResult.State toState(String stateName)