org.apache.beam.fn.harness

Class PrecombineGroupingTable<K,InputT,AccumT>

java.lang.Object

org.apache.beam.fn.harness.PrecombineGroupingTable<K,InputT,AccumT>

All Implemented Interfaces:

GroupingTable<K,InputT,AccumT>

public class PrecombineGroupingTable<K,InputT,AccumT>
extends java.lang.Object
implements GroupingTable<K,InputT,AccumT>

Static utility methods that provide GroupingTable implementations.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PrecombineGroupingTable.CoderSizeEstimator<T> Implements SizeEstimator via Coder.
static interface	PrecombineGroupingTable.Combiner<K,InputT,AccumT,OutputT> Provides client-specific operations for combining values.
static interface	PrecombineGroupingTable.GroupingKeyCreator<K> Provides client-specific operations for grouping keys.
static interface	PrecombineGroupingTable.PairInfo Provides client-specific operations for working with elements that are key/value or key/values pairs.
static interface	PrecombineGroupingTable.SizeEstimator<T> Provides client-specific operations for size estimates.
static class	PrecombineGroupingTable.ValueCombiner<K,InputT,AccumT,OutputT> Implements Precombine Combiner via Combine.KeyedCombineFn.
static class	PrecombineGroupingTable.WindowedPairInfo Implements Precombine PairInfo via KVs.
static class	PrecombineGroupingTable.WindowingCoderGroupingKeyCreator<K> Implements Precombine GroupingKeyCreator via Coder.

Nested classes/interfaces inherited from interface org.apache.beam.fn.harness.GroupingTable

GroupingTable.Receiver

Method Summary

Modifier and Type	Method and Description
static <K,InputT,AccumT> GroupingTable<org.apache.beam.sdk.util.WindowedValue<K>,InputT,AccumT>	combining(org.apache.beam.sdk.options.PipelineOptions options, org.apache.beam.sdk.transforms.Combine.CombineFn<InputT,AccumT,?> combineFn, org.apache.beam.sdk.coders.Coder<K> keyCoder, org.apache.beam.sdk.coders.Coder<? super AccumT> accumulatorCoder) Returns a GroupingTable that combines inputs into a accumulator.
static <K,InputT,AccumT> GroupingTable<org.apache.beam.sdk.util.WindowedValue<K>,InputT,AccumT>	combiningAndSampling(org.apache.beam.sdk.options.PipelineOptions options, org.apache.beam.sdk.transforms.Combine.CombineFn<InputT,AccumT,?> combineFn, org.apache.beam.sdk.coders.Coder<K> keyCoder, org.apache.beam.sdk.coders.Coder<? super AccumT> accumulatorCoder, double sizeEstimatorSampleRate) Returns a GroupingTable that combines inputs into a accumulator with sampling SizeEstimators.
void	flush(GroupingTable.Receiver output) Flushes all entries in this table to output.
void	put(K key, InputT value, GroupingTable.Receiver receiver) Adds the key and value to this table, possibly flushing some entries to output if the table is full.
void	put(java.lang.Object pair, GroupingTable.Receiver receiver) Adds a pair to this table, possibly flushing some entries to output if the table is full.
void	setMaxSize(long maxSize)
long	size()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

combining

public static <K,InputT,AccumT> GroupingTable<org.apache.beam.sdk.util.WindowedValue<K>,InputT,AccumT> combining(org.apache.beam.sdk.options.PipelineOptions options,
                                                                                                                 org.apache.beam.sdk.transforms.Combine.CombineFn<InputT,AccumT,?> combineFn,
                                                                                                                 org.apache.beam.sdk.coders.Coder<K> keyCoder,
                                                                                                                 org.apache.beam.sdk.coders.Coder<? super AccumT> accumulatorCoder)

Returns a GroupingTable that combines inputs into a accumulator.

combiningAndSampling

public static <K,InputT,AccumT> GroupingTable<org.apache.beam.sdk.util.WindowedValue<K>,InputT,AccumT> combiningAndSampling(org.apache.beam.sdk.options.PipelineOptions options,
                                                                                                                            org.apache.beam.sdk.transforms.Combine.CombineFn<InputT,AccumT,?> combineFn,
                                                                                                                            org.apache.beam.sdk.coders.Coder<K> keyCoder,
                                                                                                                            org.apache.beam.sdk.coders.Coder<? super AccumT> accumulatorCoder,
                                                                                                                            double sizeEstimatorSampleRate)

Returns a GroupingTable that combines inputs into a accumulator with sampling SizeEstimators.

put

public void put(java.lang.Object pair,
                GroupingTable.Receiver receiver)
         throws java.lang.Exception

Adds a pair to this table, possibly flushing some entries to output if the table is full.

Specified by:

put in interface GroupingTable<K,InputT,AccumT>

Throws:

java.lang.Exception

put

public void put(K key,
                InputT value,
                GroupingTable.Receiver receiver)
         throws java.lang.Exception

Adds the key and value to this table, possibly flushing some entries to output if the table is full.

Throws:

java.lang.Exception

flush

public void flush(GroupingTable.Receiver output)
           throws java.lang.Exception

Flushes all entries in this table to output.

Specified by:

flush in interface GroupingTable<K,InputT,AccumT>

Throws:

java.lang.Exception

setMaxSize

public void setMaxSize(long maxSize)

size

public long size()