Package org.apache.beam.runners.spark.metrics

Class MetricsAccumulator.AccumulatorCheckpointingSparkListener

java.lang.Object

org.apache.spark.streaming.api.java.JavaStreamingListener

org.apache.beam.runners.spark.metrics.MetricsAccumulator.AccumulatorCheckpointingSparkListener

Enclosing class:

MetricsAccumulator

public static class MetricsAccumulator.AccumulatorCheckpointingSparkListener
extends org.apache.spark.streaming.api.java.JavaStreamingListener

Spark Listener which checkpoints MetricsContainerStepMap values for fault-tolerance.

Constructor Summary

Constructors

Constructor	Description
AccumulatorCheckpointingSparkListener()

Method Summary

Modifier and Type	Method	Description
void	onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)

Methods inherited from class org.apache.spark.streaming.api.java.JavaStreamingListener

onBatchStarted, onBatchSubmitted, onOutputOperationCompleted, onOutputOperationStarted, onReceiverError, onReceiverStarted, onReceiverStopped, onStreamingStarted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AccumulatorCheckpointingSparkListener

public AccumulatorCheckpointingSparkListener()

Method Detail

onBatchCompleted

public void onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)

Overrides:

onBatchCompleted in class org.apache.spark.streaming.api.java.JavaStreamingListener