org.apache.beam.runners.flink.translation.functions

Class FlinkNonMergingReduceFunction<K,InputT>

java.lang.Object

org.apache.beam.runners.flink.translation.functions.FlinkNonMergingReduceFunction<K,InputT>

Type Parameters:

K - Key type.

InputT - Input type.

All Implemented Interfaces:

java.io.Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>,org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,java.lang.Iterable<InputT>>>>

public class FlinkNonMergingReduceFunction<K,InputT>
extends java.lang.Object
implements org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>,org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,java.lang.Iterable<InputT>>>>

Reduce function for non-merging GBK implementation. Implementation tries to return non-iterable results when possible, so we do not have to materialize all values for a single key in memory.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FlinkNonMergingReduceFunction(org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy, boolean reIterableResult)

Method Summary

Modifier and Type	Method and Description
void	reduce(java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> input, org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,java.lang.Iterable<InputT>>>> coll)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkNonMergingReduceFunction

public FlinkNonMergingReduceFunction(org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy,
                                     boolean reIterableResult)

Method Detail

reduce

public void reduce(java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> input,
                   org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,java.lang.Iterable<InputT>>>> coll)

Specified by:

reduce in interface org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>,org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,java.lang.Iterable<InputT>>>>