org.apache.beam.runners.samza.runtime

Class AsyncDoFnRunner<InT,OutT>

java.lang.Object

org.apache.beam.runners.samza.runtime.AsyncDoFnRunner<InT,OutT>

All Implemented Interfaces:

org.apache.beam.runners.core.DoFnRunner<InT,OutT>

public class AsyncDoFnRunner<InT,OutT>
extends java.lang.Object
implements org.apache.beam.runners.core.DoFnRunner<InT,OutT>

This DoFnRunner adds the capability of executing the DoFn.ProcessElement in the thread pool, and returns the future to the collector for the underlying async execution.

Method Summary

Modifier and Type	Method and Description
static <InT,OutT> AsyncDoFnRunner<InT,OutT>	create(org.apache.beam.runners.core.DoFnRunner<InT,OutT> runner, OpEmitter<OutT> emitter, FutureCollector<OutT> futureCollector, boolean isStateful, SamzaPipelineOptions options)
void	finishBundle()
org.apache.beam.sdk.transforms.DoFn<InT,OutT>	getFn()
<KeyT> void	onTimer(java.lang.String timerId, java.lang.String timerFamilyId, KeyT key, org.apache.beam.sdk.transforms.windowing.BoundedWindow window, org.joda.time.Instant timestamp, org.joda.time.Instant outputTimestamp, org.apache.beam.sdk.state.TimeDomain timeDomain)
<KeyT> void	onWindowExpiration(org.apache.beam.sdk.transforms.windowing.BoundedWindow window, org.joda.time.Instant timestamp, KeyT key)
void	processElement(org.apache.beam.sdk.util.WindowedValue<InT> elem)
void	startBundle()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static <InT,OutT> AsyncDoFnRunner<InT,OutT> create(org.apache.beam.runners.core.DoFnRunner<InT,OutT> runner,
                                                          OpEmitter<OutT> emitter,
                                                          FutureCollector<OutT> futureCollector,
                                                          boolean isStateful,
                                                          SamzaPipelineOptions options)

startBundle

public void startBundle()

Specified by:

startBundle in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>

processElement

public void processElement(org.apache.beam.sdk.util.WindowedValue<InT> elem)

Specified by:

processElement in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>

onTimer

public <KeyT> void onTimer(java.lang.String timerId,
                           java.lang.String timerFamilyId,
                           KeyT key,
                           org.apache.beam.sdk.transforms.windowing.BoundedWindow window,
                           org.joda.time.Instant timestamp,
                           org.joda.time.Instant outputTimestamp,
                           org.apache.beam.sdk.state.TimeDomain timeDomain)

Specified by:

onTimer in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>

finishBundle

public void finishBundle()

Specified by:

finishBundle in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>

onWindowExpiration

public <KeyT> void onWindowExpiration(org.apache.beam.sdk.transforms.windowing.BoundedWindow window,
                                      org.joda.time.Instant timestamp,
                                      KeyT key)

Specified by:

onWindowExpiration in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>

getFn

public org.apache.beam.sdk.transforms.DoFn<InT,OutT> getFn()

Specified by:

getFn in interface org.apache.beam.runners.core.DoFnRunner<InT,OutT>