org.apache.beam.fn.harness.control

Class ProcessBundleHandler

java.lang.Object

org.apache.beam.fn.harness.control.ProcessBundleHandler

public class ProcessBundleHandler
extends java.lang.Object

Processes BeamFnApi.ProcessBundleRequests by materializing the set of required runners for each RunnerApi.FunctionSpec, wiring them together based upon the input and output map definitions.

Finally executes the DAG based graph by starting all runners in reverse topological order, and finishing all runners in forward topological order.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	JAVA_SOURCE_URN

Constructor Summary

Constructors

Constructor and Description
ProcessBundleHandler(org.apache.beam.sdk.options.PipelineOptions options, java.util.function.Function<java.lang.String,org.apache.beam.vendor.grpc.v1p13p1.com.google.protobuf.Message> fnApiRegistry, BeamFnDataClient beamFnDataClient, BeamFnStateGrpcClientCache beamFnStateGrpcClientCache)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.model.fnexecution.v1.BeamFnApi.InstructionResponse.Builder	processBundle(org.apache.beam.model.fnexecution.v1.BeamFnApi.InstructionRequest request) Processes a bundle, running the start(), process(), and finish() functions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

JAVA_SOURCE_URN

public static final java.lang.String JAVA_SOURCE_URN

See Also:

Constant Field Values

Constructor Detail

ProcessBundleHandler

public ProcessBundleHandler(org.apache.beam.sdk.options.PipelineOptions options,
                            java.util.function.Function<java.lang.String,org.apache.beam.vendor.grpc.v1p13p1.com.google.protobuf.Message> fnApiRegistry,
                            BeamFnDataClient beamFnDataClient,
                            BeamFnStateGrpcClientCache beamFnStateGrpcClientCache)

Method Detail

processBundle

public org.apache.beam.model.fnexecution.v1.BeamFnApi.InstructionResponse.Builder processBundle(org.apache.beam.model.fnexecution.v1.BeamFnApi.InstructionRequest request)
                                                                                         throws java.lang.Exception

Processes a bundle, running the start(), process(), and finish() functions. This function is required to be reentrant.

Throws:

java.lang.Exception