org.apache.beam.runners.samza.translation

Class ReshuffleTranslator<K,InT,OutT>

java.lang.Object

org.apache.beam.runners.samza.translation.ReshuffleTranslator<K,InT,OutT>

All Implemented Interfaces:

TransformTranslator<org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>>>

public class ReshuffleTranslator<K,InT,OutT>
extends java.lang.Object
implements TransformTranslator<org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>>>

Translates Reshuffle transform into Samza's native partitionBy operator, which will partition each incoming message by the key into a Task corresponding to that key.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ReshuffleTranslator.IsSamzaNativeTransform Predicate to determine whether a URN is a Samza native transform.

Constructor Summary

Constructors

Constructor and Description
ReshuffleTranslator()

Method Summary

Modifier and Type	Method and Description
void	translate(org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>> transform, org.apache.beam.sdk.runners.TransformHierarchy.Node node, TranslationContext ctx) Translates the Java PTransform into Samza API.
void	translatePortable(org.apache.beam.runners.core.construction.graph.PipelineNode.PTransformNode transform, org.apache.beam.runners.core.construction.graph.QueryablePipeline pipeline, PortableTranslationContext ctx) Translates the portable RunnerApi.PTransform into Samza API.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReshuffleTranslator

public ReshuffleTranslator()

Method Detail

translate

public void translate(org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>> transform,
                      org.apache.beam.sdk.runners.TransformHierarchy.Node node,
                      TranslationContext ctx)

Description copied from interface: TransformTranslator

Translates the Java PTransform into Samza API.

Specified by:

translate in interface TransformTranslator<org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>>>

translatePortable

public void translatePortable(org.apache.beam.runners.core.construction.graph.PipelineNode.PTransformNode transform,
                              org.apache.beam.runners.core.construction.graph.QueryablePipeline pipeline,
                              PortableTranslationContext ctx)

Description copied from interface: TransformTranslator

Translates the portable RunnerApi.PTransform into Samza API.

Specified by:

translatePortable in interface TransformTranslator<org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,InT>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,OutT>>>>