org.apache.beam.runners.flink.translation.functions

Class FlinkMultiOutputPruningFunction<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue>,org.apache.beam.sdk.util.WindowedValue<T>>

org.apache.beam.runners.flink.translation.functions.FlinkMultiOutputPruningFunction<T>

All Implemented Interfaces:

java.io.Serializable, org.apache.flink.api.common.functions.FlatMapFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue>,org.apache.beam.sdk.util.WindowedValue<T>>, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class FlinkMultiOutputPruningFunction<T>
extends org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue>,org.apache.beam.sdk.util.WindowedValue<T>>

A FlatMapFunction function that filters out those elements that don't belong in this output. We need this to implement MultiOutput ParDo functions in combination with FlinkDoFnFunction.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FlinkMultiOutputPruningFunction(int ourOutputTag, org.apache.beam.sdk.options.PipelineOptions options)

Method Summary

Modifier and Type	Method and Description
void	flatMap(org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue> windowedValue, org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<T>> collector)
void	open(org.apache.flink.configuration.Configuration parameters)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkMultiOutputPruningFunction

public FlinkMultiOutputPruningFunction(int ourOutputTag,
                                       org.apache.beam.sdk.options.PipelineOptions options)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

flatMap

public void flatMap(org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue> windowedValue,
                    org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<T>> collector)
             throws java.lang.Exception

Specified by:

flatMap in interface org.apache.flink.api.common.functions.FlatMapFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue>,org.apache.beam.sdk.util.WindowedValue<T>>

Specified by:

flatMap in class org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.transforms.join.RawUnionValue>,org.apache.beam.sdk.util.WindowedValue<T>>

Throws:

java.lang.Exception