org.apache.beam.runners.samza.runtime

Class SplittableParDoProcessKeyedElementsOp<InputT,OutputT,RestrictionT,PositionT,WatermarkEstimatorStateT>

java.lang.Object

org.apache.beam.runners.samza.runtime.SplittableParDoProcessKeyedElementsOp<InputT,OutputT,RestrictionT,PositionT,WatermarkEstimatorStateT>

All Implemented Interfaces:

java.io.Serializable, Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>

public class SplittableParDoProcessKeyedElementsOp<InputT,OutputT,RestrictionT,PositionT,WatermarkEstimatorStateT>
extends java.lang.Object
implements Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>

Samza operator for GroupByKey.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description

SplittableParDoProcessKeyedElementsOp(org.apache.beam.sdk.values.TupleTag<OutputT> mainOutputTag, org.apache.beam.runners.core.construction.SplittableParDo.ProcessKeyedElements<InputT,OutputT,RestrictionT,WatermarkEstimatorStateT> processKeyedElements, org.apache.beam.sdk.values.WindowingStrategy<?,org.apache.beam.sdk.transforms.windowing.BoundedWindow> windowingStrategy, OutputManagerFactory<org.apache.beam.sdk.transforms.join.RawUnionValue> outputManagerFactory, java.lang.String transformFullName, java.lang.String transformId, org.apache.beam.sdk.values.PCollection.IsBounded isBounded)

Method Summary

Modifier and Type	Method and Description
void	open(org.apache.samza.config.Config config, org.apache.samza.context.Context context, org.apache.samza.operators.Scheduler<KeyedTimerData<byte[]>> timerRegistry, OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter) A hook that allows initialization for any non-serializable operator state, such as getting stores.
void	processElement(org.apache.beam.sdk.util.WindowedValue<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>> inputElement, OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)
void	processTimer(KeyedTimerData<byte[]> keyedTimerData, OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)
void	processWatermark(org.joda.time.Instant watermark, OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.runners.samza.runtime.Op

close, processSideInput, processSideInputWatermark

Constructor Detail

SplittableParDoProcessKeyedElementsOp

public SplittableParDoProcessKeyedElementsOp(org.apache.beam.sdk.values.TupleTag<OutputT> mainOutputTag,
                                             org.apache.beam.runners.core.construction.SplittableParDo.ProcessKeyedElements<InputT,OutputT,RestrictionT,WatermarkEstimatorStateT> processKeyedElements,
                                             org.apache.beam.sdk.values.WindowingStrategy<?,org.apache.beam.sdk.transforms.windowing.BoundedWindow> windowingStrategy,
                                             OutputManagerFactory<org.apache.beam.sdk.transforms.join.RawUnionValue> outputManagerFactory,
                                             java.lang.String transformFullName,
                                             java.lang.String transformId,
                                             org.apache.beam.sdk.values.PCollection.IsBounded isBounded)

Method Detail

open

public void open(org.apache.samza.config.Config config,
                 org.apache.samza.context.Context context,
                 org.apache.samza.operators.Scheduler<KeyedTimerData<byte[]>> timerRegistry,
                 OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)

Description copied from interface: Op

A hook that allows initialization for any non-serializable operator state, such as getting stores.

While an emitter is supplied to this function it is not usable except in the methods Op.processElement(WindowedValue, OpEmitter), Op.processWatermark(Instant, OpEmitter), and Op.processSideInput(String, WindowedValue, OpEmitter).

Specified by:

open in interface Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>

processElement

public void processElement(org.apache.beam.sdk.util.WindowedValue<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>> inputElement,
                           OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)

Specified by:

processElement in interface Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>

processWatermark

public void processWatermark(org.joda.time.Instant watermark,
                             OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)

Specified by:

processWatermark in interface Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>

processTimer

public void processTimer(KeyedTimerData<byte[]> keyedTimerData,
                         OpEmitter<org.apache.beam.sdk.transforms.join.RawUnionValue> emitter)

Specified by:

processTimer in interface Op<org.apache.beam.runners.core.KeyedWorkItem<byte[],org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,org.apache.beam.sdk.transforms.join.RawUnionValue,byte[]>