Package org.apache.beam.runners.spark

Class SparkPipelineRunner

java.lang.Object

org.apache.beam.runners.spark.SparkPipelineRunner

All Implemented Interfaces:

org.apache.beam.runners.jobsubmission.PortablePipelineRunner

public class SparkPipelineRunner
extends java.lang.Object
implements org.apache.beam.runners.jobsubmission.PortablePipelineRunner

Runs a portable pipeline on Apache Spark.

Constructor Summary

Constructors

Constructor	Description
SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Summary

Modifier and Type	Method	Description
static void	main(java.lang.String[] args)	Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
org.apache.beam.runners.jobsubmission.PortablePipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.runners.fnexecution.provisioning.JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkPipelineRunner

public SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Detail

run

public org.apache.beam.runners.jobsubmission.PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
                                                                        org.apache.beam.runners.fnexecution.provisioning.JobInfo jobInfo)

Specified by:

run in interface org.apache.beam.runners.jobsubmission.PortablePipelineRunner

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

Throws:

java.lang.Exception