Package org.apache.beam.runners.spark.structuredstreaming
Internal implementation of the Beam runner for Apache Spark.
-
Interface Summary Interface Description SparkStructuredStreamingPipelineOptions Spark runnerPipelineOptionshandles Spark execution-related configurations, such as the master address, and other user-related knobs. -
Class Summary Class Description SparkStructuredStreamingPipelineResult SparkStructuredStreamingRunner A Spark runner build on top of Spark's SQL Engine (Structured Streaming framework).SparkStructuredStreamingRunnerRegistrar Contains thePipelineRunnerRegistrarandPipelineOptionsRegistrarfor theSparkStructuredStreamingRunner.SparkStructuredStreamingRunnerRegistrar.Options Registers theSparkStructuredStreamingPipelineOptions.SparkStructuredStreamingRunnerRegistrar.Runner Registers theSparkStructuredStreamingRunner.