Package org.apache.beam.runners.spark.translation.streaming

Class SparkRunnerStreamingContextFactory

java.lang.Object

org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

public class SparkRunnerStreamingContextFactory
extends java.lang.Object
implements org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

A JavaStreamingContext factory for resilience.

See Also:

how-to-configure-checkpointing, Serialized Form

Constructor Summary

Constructors

Constructor	Description
SparkRunnerStreamingContextFactory(org.apache.beam.sdk.Pipeline pipeline, SparkPipelineOptions options, Checkpoint.CheckpointDir checkpointDir)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.streaming.api.java.JavaStreamingContext	call()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkRunnerStreamingContextFactory

public SparkRunnerStreamingContextFactory(org.apache.beam.sdk.Pipeline pipeline,
                                          SparkPipelineOptions options,
                                          Checkpoint.CheckpointDir checkpointDir)

Method Detail

call

public org.apache.spark.streaming.api.java.JavaStreamingContext call()
                                                              throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

Throws:

java.lang.Exception