Package org.apache.beam.runners.spark.util
Internal utilities to translate Beam pipelines to Spark.
-
Class Summary Class Description ByteArray Serializable byte array.CachedSideInputReader SideInputReaderthat caches materialized views.GlobalWatermarkHolder A store to hold the global watermarks for a micro-batch.GlobalWatermarkHolder.SparkWatermarks AGlobalWatermarkHolder.SparkWatermarksholds the watermarks and batch time relevant to a micro-batch input from a specific source.GlobalWatermarkHolder.WatermarkAdvancingStreamingListener Advance the WMs onBatchCompleted event.SideInputBroadcast<T> Broadcast helper for side inputs.SparkSideInputReader ASideInputReaderfor the SparkRunner.TimerUtils