Package org.apache.beam.runners.spark.translation.streaming

Internal utilities to translate Beam pipelines to Spark streaming.

Class Summary

Class	Description
Checkpoint	Checkpoint data to make it available in future pipeline runs.
Checkpoint.CheckpointDir	Checkpoint dir tree.
SparkRunnerStreamingContextFactory	A JavaStreamingContext factory for resilience.
StreamingTransformTranslator	Supports translation between a Beam transform, and Spark's operations on DStreams.
StreamingTransformTranslator.SparkTransformsRegistrar	Registers classes specialized by the Spark runner.
StreamingTransformTranslator.Translator	Translator matches Beam transformation with the appropriate evaluator.
TestDStream<T>
UnboundedDataset<T>	DStream holder Can also crate a DStream from a supplied queue of values, but mainly for testing.