org.apache.beam.runners.dataflow

Interface TransformTranslator.TranslationContext

Enclosing interface:

TransformTranslator<TransformT extends org.apache.beam.sdk.transforms.PTransform>

public static interface TransformTranslator.TranslationContext

The interface provided to registered callbacks for interacting with the DataflowRunner, including reading and writing the values of PCollections and side inputs.

Method Summary

Modifier and Type	Method and Description
TransformTranslator.StepTranslationContext	addStep(org.apache.beam.sdk.transforms.PTransform<?,?> transform, java.lang.String type) Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.
OutputReference	asOutputReference(org.apache.beam.sdk.values.PValue value, org.apache.beam.sdk.runners.AppliedPTransform<?,?,?> producer) Encode a PValue reference as an output reference.
org.apache.beam.sdk.runners.AppliedPTransform<?,?,?>	getCurrentParent() Gets the parent composite transform to the current transform, if one exists.
org.apache.beam.sdk.runners.AppliedPTransform<?,?,?>	getCurrentTransform()
java.lang.String	getFullName(org.apache.beam.sdk.transforms.PTransform<?,?> transform) Returns the full name of the currently being translated transform.
<InputT extends org.apache.beam.sdk.values.PValue> InputT	getInput(org.apache.beam.sdk.transforms.PTransform<InputT,?> transform)
<InputT extends org.apache.beam.sdk.values.PInput> java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue>	getInputs(org.apache.beam.sdk.transforms.PTransform<InputT,?> transform) Returns the input of the currently being translated transform.
<OutputT extends org.apache.beam.sdk.values.PValue> OutputT	getOutput(org.apache.beam.sdk.transforms.PTransform<?,OutputT> transform)
<OutputT extends org.apache.beam.sdk.values.POutput> java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue>	getOutputs(org.apache.beam.sdk.transforms.PTransform<?,OutputT> transform) Returns the output of the currently being translated transform.
DataflowPipelineOptions	getPipelineOptions() Returns the configured pipeline options.
org.apache.beam.sdk.runners.AppliedPTransform<?,?,?>	getProducer(org.apache.beam.sdk.values.PValue value) Get the AppliedPTransform that produced the provided PValue.
org.apache.beam.runners.core.construction.SdkComponents	getSdkComponents()
default boolean	isFnApi()

Method Detail

isFnApi

default boolean isFnApi()

getPipelineOptions

DataflowPipelineOptions getPipelineOptions()

Returns the configured pipeline options.

getInputs

<InputT extends org.apache.beam.sdk.values.PInput> java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue> getInputs(org.apache.beam.sdk.transforms.PTransform<InputT,?> transform)

Returns the input of the currently being translated transform.

getInput

<InputT extends org.apache.beam.sdk.values.PValue> InputT getInput(org.apache.beam.sdk.transforms.PTransform<InputT,?> transform)

getOutputs

<OutputT extends org.apache.beam.sdk.values.POutput> java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue> getOutputs(org.apache.beam.sdk.transforms.PTransform<?,OutputT> transform)

Returns the output of the currently being translated transform.

getOutput

<OutputT extends org.apache.beam.sdk.values.PValue> OutputT getOutput(org.apache.beam.sdk.transforms.PTransform<?,OutputT> transform)

getFullName

java.lang.String getFullName(org.apache.beam.sdk.transforms.PTransform<?,?> transform)

Returns the full name of the currently being translated transform.

addStep

TransformTranslator.StepTranslationContext addStep(org.apache.beam.sdk.transforms.PTransform<?,?> transform,
                                                   java.lang.String type)

Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.

asOutputReference

OutputReference asOutputReference(org.apache.beam.sdk.values.PValue value,
                                  org.apache.beam.sdk.runners.AppliedPTransform<?,?,?> producer)

Encode a PValue reference as an output reference.

getSdkComponents

org.apache.beam.runners.core.construction.SdkComponents getSdkComponents()

getCurrentTransform

org.apache.beam.sdk.runners.AppliedPTransform<?,?,?> getCurrentTransform()

getProducer

org.apache.beam.sdk.runners.AppliedPTransform<?,?,?> getProducer(org.apache.beam.sdk.values.PValue value)

Get the AppliedPTransform that produced the provided PValue.

getCurrentParent

org.apache.beam.sdk.runners.AppliedPTransform<?,?,?> getCurrentParent()

Gets the parent composite transform to the current transform, if one exists. Otherwise returns one null.