org.apache.beam.runners.dataflow

Interface TransformTranslator.TranslationContext

Enclosing interface:

TransformTranslator<TransformT extends PTransform>

public static interface TransformTranslator.TranslationContext

The interface provided to registered callbacks for interacting with the DataflowRunner, including reading and writing the values of PCollections and side inputs.

Method Summary

Modifier and Type	Method and Description
TransformTranslator.StepTranslationContext	addStep(PTransform<?,?> transform, String type) Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.
OutputReference	asOutputReference(PValue value, AppliedPTransform<?,?,?> producer) Encode a PValue reference as an output reference.
String	getFullName(PTransform<?,?> transform) Returns the full name of the currently being translated transform.
<InputT extends PValue> InputT	getInput(PTransform<InputT,?> transform)
<InputT extends PInput> Map<TupleTag<?>,PValue>	getInputs(PTransform<InputT,?> transform) Returns the input of the currently being translated transform.
<OutputT extends PValue> OutputT	getOutput(PTransform<?,OutputT> transform)
<OutputT extends POutput> Map<TupleTag<?>,PValue>	getOutputs(PTransform<?,OutputT> transform) Returns the output of the currently being translated transform.
DataflowPipelineOptions	getPipelineOptions() Returns the configured pipeline options.
AppliedPTransform<?,?,?>	getProducer(PValue value) Get the AppliedPTransform that produced the provided PValue.

Method Detail

getPipelineOptions

DataflowPipelineOptions getPipelineOptions()

Returns the configured pipeline options.

getInputs

<InputT extends PInput> Map<TupleTag<?>,PValue> getInputs(PTransform<InputT,?> transform)

Returns the input of the currently being translated transform.

getInput

<InputT extends PValue> InputT getInput(PTransform<InputT,?> transform)

getOutputs

<OutputT extends POutput> Map<TupleTag<?>,PValue> getOutputs(PTransform<?,OutputT> transform)

Returns the output of the currently being translated transform.

getOutput

<OutputT extends PValue> OutputT getOutput(PTransform<?,OutputT> transform)

getFullName

String getFullName(PTransform<?,?> transform)

Returns the full name of the currently being translated transform.

addStep

TransformTranslator.StepTranslationContext addStep(PTransform<?,?> transform,
                                                   String type)

Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.

asOutputReference

OutputReference asOutputReference(PValue value,
                                  AppliedPTransform<?,?,?> producer)

Encode a PValue reference as an output reference.

getProducer

AppliedPTransform<?,?,?> getProducer(PValue value)

Get the AppliedPTransform that produced the provided PValue.