org.apache.beam.runners.samza.runtime

Interface Op<InT,OutT,K>

All Superinterfaces:

java.io.Serializable

All Known Implementing Classes:

DoFnOp, GroupByKeyOp, KvToKeyedWorkItemOp, PortableDoFnOp, SplittableParDoProcessKeyedElementsOp, WindowAssignOp

public interface Op<InT,OutT,K>
extends java.io.Serializable

Interface of Samza operator for BEAM. This interface demultiplexes messages from BEAM so that elements and side inputs can be handled separately in Samza. Watermark propagation can be overridden so we can hold watermarks for side inputs. The output values and watermark will be collected via OpEmitter.

Method Summary

Modifier and Type	Method and Description
default void	close()
default void	open(org.apache.samza.config.Config config, org.apache.samza.context.Context context, org.apache.samza.operators.Scheduler<KeyedTimerData<K>> timerRegistry, OpEmitter<OutT> emitter) A hook that allows initialization for any non-serializable operator state, such as getting stores.
void	processElement(org.apache.beam.sdk.util.WindowedValue<InT> inputElement, OpEmitter<OutT> emitter)
default void	processSideInput(java.lang.String id, org.apache.beam.sdk.util.WindowedValue<? extends java.lang.Iterable<?>> elements, OpEmitter<OutT> emitter)
default void	processSideInputWatermark(org.joda.time.Instant watermark, OpEmitter<OutT> emitter)
default void	processTimer(KeyedTimerData<K> keyedTimerData, OpEmitter<OutT> emitter)
default void	processWatermark(org.joda.time.Instant watermark, OpEmitter<OutT> emitter)

Method Detail

open

default void open(org.apache.samza.config.Config config,
                  org.apache.samza.context.Context context,
                  org.apache.samza.operators.Scheduler<KeyedTimerData<K>> timerRegistry,
                  OpEmitter<OutT> emitter)

A hook that allows initialization for any non-serializable operator state, such as getting stores.

While an emitter is supplied to this function it is not usable except in the methods processElement(WindowedValue, OpEmitter), processWatermark(Instant, OpEmitter), and processSideInput(String, WindowedValue, OpEmitter).

processElement

void processElement(org.apache.beam.sdk.util.WindowedValue<InT> inputElement,
                    OpEmitter<OutT> emitter)

processWatermark

default void processWatermark(org.joda.time.Instant watermark,
                              OpEmitter<OutT> emitter)

processSideInput

default void processSideInput(java.lang.String id,
                              org.apache.beam.sdk.util.WindowedValue<? extends java.lang.Iterable<?>> elements,
                              OpEmitter<OutT> emitter)

processSideInputWatermark

default void processSideInputWatermark(org.joda.time.Instant watermark,
                                       OpEmitter<OutT> emitter)

processTimer

default void processTimer(KeyedTimerData<K> keyedTimerData,
                          OpEmitter<OutT> emitter)

close

default void close()