org.apache.beam.runners.flink.translation.functions

Class SortingFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>

java.lang.Object

org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner<K,InputT,AccumT,OutputT,W>

org.apache.beam.runners.flink.translation.functions.SortingFlinkCombineRunner<K,InputT,AccumT,OutputT,W>

public class SortingFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>
extends AbstractFlinkCombineRunner<K,InputT,AccumT,OutputT,W>

A Flink combine runner that first sorts the elements by window and then does one pass that merges windows and outputs results.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner

AbstractFlinkCombineRunner.CompleteFlinkCombiner<K,InputT,AccumT,OutputT>, AbstractFlinkCombineRunner.FinalFlinkCombiner<K,AccumT,OutputT>, AbstractFlinkCombineRunner.FlinkCombiner<K,InputT,AccumT,OutputT>, AbstractFlinkCombineRunner.PartialFlinkCombiner<K,InputT,AccumT>

Constructor Summary

Constructors

Constructor and Description
SortingFlinkCombineRunner()

Method Summary

Modifier and Type

Method and Description

void

combine(AbstractFlinkCombineRunner.FlinkCombiner<K,InputT,AccumT,OutputT> flinkCombiner, org.apache.beam.sdk.values.WindowingStrategy<java.lang.Object,W> windowingStrategy, org.apache.beam.runners.core.SideInputReader sideInputReader, org.apache.beam.sdk.options.PipelineOptions options, java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> elements, org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>>> out) Consumes WindowedValues and produces combined output to the given output.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SortingFlinkCombineRunner

public SortingFlinkCombineRunner()

Method Detail

combine

public void combine(AbstractFlinkCombineRunner.FlinkCombiner<K,InputT,AccumT,OutputT> flinkCombiner,
                    org.apache.beam.sdk.values.WindowingStrategy<java.lang.Object,W> windowingStrategy,
                    org.apache.beam.runners.core.SideInputReader sideInputReader,
                    org.apache.beam.sdk.options.PipelineOptions options,
                    java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> elements,
                    org.apache.flink.util.Collector<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>>> out)
             throws java.lang.Exception

Description copied from class: AbstractFlinkCombineRunner

Consumes WindowedValues and produces combined output to the given output.

Specified by:

combine in class AbstractFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>

Throws:

java.lang.Exception