A B C D E F G H I K L M N O P R S T U V W

A

AbstractFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

Abstract base for runners that execute a Combine.PerKey.

AbstractFlinkCombineRunner() - Constructor for class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner

AbstractFlinkCombineRunner.CompleteFlinkCombiner<K,InputT,AccumT,OutputT> - Class in org.apache.beam.runners.flink.translation.functions

A straight wrapper of CombineFnBase.GlobalCombineFn that takes in InputT and emits OutputT.

AbstractFlinkCombineRunner.FinalFlinkCombiner<K,AccumT,OutputT> - Class in org.apache.beam.runners.flink.translation.functions

A final combiner that takes in AccumT and produces OutputT.

AbstractFlinkCombineRunner.FlinkCombiner<K,InputT,AccumT,OutputT> - Interface in org.apache.beam.runners.flink.translation.functions

Adapter interface that allows using a CombineFnBase.GlobalCombineFn to either produce the AccumT as output or to combine several accumulators into an OutputT.

AbstractFlinkCombineRunner.PartialFlinkCombiner<K,InputT,AccumT> - Class in org.apache.beam.runners.flink.translation.functions

A partial combiner that takes in InputT and produces AccumT.

AbstractStreamOperatorCompat<OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Compatibility layer for AbstractStreamOperator breaking changes.

AbstractStreamOperatorCompat() - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.AbstractStreamOperatorCompat

ACCUMULATOR_NAME - Static variable in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer

add(MetricsContainerStepMap) - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator

addDataSet(String, DataSet<T>) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

addDataStream(String, DataStream<T>) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

addInput(K, AccumT, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.CompleteFlinkCombiner

addInput(K, AccumT, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FinalFlinkCombiner

addInput(K, AccumT, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in interface org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FlinkCombiner

addInput(K, AccumT, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.PartialFlinkCombiner

additionalOutputTags - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

addSideInputValue(StreamRecord<RawUnionValue>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

Add the side input value.

addSideInputValue(StreamRecord<RawUnionValue>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

addWatermarkHoldUsage(Instant) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

applyInputWatermarkHold(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

Allows to apply a hold to the input watermark.

applyInputWatermarkHold(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

applyOutputWatermarkHold(long, long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

Allows to apply a hold to the output watermark before it is send out.

applyOutputWatermarkHold(long, long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

AUTO - Static variable in interface org.apache.beam.runners.flink.FlinkPipelineOptions

B

BeamStoppableFunction - Interface in org.apache.beam.runners.flink.translation.wrappers.streaming.io

Custom StoppableFunction for backward compatibility.

bindBag(String, StateSpec<BagState<T>>, Coder<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindCombining(String, StateSpec<CombiningState<InputT, AccumT, OutputT>>, Coder<AccumT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindCombiningWithContext(String, StateSpec<CombiningState<InputT, AccumT, OutputT>>, Coder<AccumT>, CombineWithContext.CombineFnWithContext<InputT, AccumT, OutputT>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindMap(String, StateSpec<MapState<KeyT, ValueT>>, Coder<KeyT>, Coder<ValueT>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindOrderedList(String, StateSpec<OrderedListState<T>>, Coder<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindSet(String, StateSpec<SetState<T>>, Coder<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindValue(String, StateSpec<ValueState<T>>, Coder<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

bindWatermark(String, StateSpec<WatermarkHoldState>, TimestampCombiner) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

buffer(BufferedElement) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.KeyedBufferingElementsHandler

buffer(BufferedElement) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.NonKeyedBufferingElementsHandler

BufferedElement - Interface in org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput

An interface for elements buffered during a checkpoint when using @RequiresStableInput.

bufferingDoFnRunner - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

BufferingDoFnRunner<InputT,OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput

A DoFnRunner which buffers data for supporting DoFn.RequiresStableInput.

bundleFinalizer() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.FlinkStepContext

C

cancel() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

cancel() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

cancel() - Method in class org.apache.beam.runners.flink.translation.functions.ImpulseSourceFunction

cancel() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.StreamingImpulseSource

Deprecated.

cancel() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.TestStreamSource

cancel() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

canEqual(Object) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

canEqual(Object) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

checkpoint(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

Should be called when a checkpoint is created.

checkpointCompleted(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

Should be called when a checkpoint is completed.

CheckpointStats - Class in org.apache.beam.runners.flink.translation.utils

Helpers for reporting checkpoint durations.

CheckpointStats(Supplier<DistributionCell>) - Constructor for class org.apache.beam.runners.flink.translation.utils.CheckpointStats

cleanUp() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

clear() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.KeyedBufferingElementsHandler

clear() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.NonKeyedBufferingElementsHandler

clearGlobalState() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

Allows to clear all state for the global watermark when the maximum watermark arrives.

clone() - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator

close() - Method in class org.apache.beam.runners.flink.metrics.FileReporter

close() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction

close() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction

close() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkStatefulDoFnFunction

close() - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

close() - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

close() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.AbstractStreamOperatorCompat

close() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

close() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SplittableDoFnOperator

CoderTypeInformation<T> - Class in org.apache.beam.runners.flink.translation.types

Flink TypeInformation for Beam Coders.

CoderTypeInformation(Coder<T>, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

CoderTypeSerializer<T> - Class in org.apache.beam.runners.flink.translation.types

Flink TypeSerializer for Beam Coders.

CoderTypeSerializer(Coder<T>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

CoderTypeSerializer.LegacySnapshot<T> - Class in org.apache.beam.runners.flink.translation.types

A legacy snapshot which does not care about schema compatibility.

combine(AbstractFlinkCombineRunner.FlinkCombiner<K, InputT, AccumT, OutputT>, WindowingStrategy<Object, W>, SideInputReader, PipelineOptions, Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner

Consumes WindowedValues and produces combined output to the given output.

combine(Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, AccumT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

combine(AbstractFlinkCombineRunner.FlinkCombiner<K, InputT, AccumT, OutputT>, WindowingStrategy<Object, W>, SideInputReader, PipelineOptions, Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.HashingFlinkCombineRunner

combine(AbstractFlinkCombineRunner.FlinkCombiner<K, InputT, AccumT, OutputT>, WindowingStrategy<Object, W>, SideInputReader, PipelineOptions, Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.SingleWindowFlinkCombineRunner

combine(AbstractFlinkCombineRunner.FlinkCombiner<K, InputT, AccumT, OutputT>, WindowingStrategy<Object, W>, SideInputReader, PipelineOptions, Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.SortingFlinkCombineRunner

combineFn - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

combineFn - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

compare(byte[], byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

compareSerialized(DataInputView, DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

compareToReference(TypeComparator<byte[]>) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

CompleteFlinkCombiner(CombineFnBase.GlobalCombineFn<InputT, AccumT, OutputT>) - Constructor for class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.CompleteFlinkCombiner

configure(Configuration) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

configure(Configuration) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

consistentWithEquals() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

.

contains(PCollectionView<T>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkSideInputReader

copy(T) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

copy(T, T) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

copy(DataInputView, DataOutputView) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

copy(byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

copy(byte[], byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

copy(DataInputView, DataOutputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

CountingPipelineVisitor - Class in org.apache.beam.runners.flink.translation.utils

Pipeline visitors that fills a lookup table of PValue to number of consumers.

CountingPipelineVisitor() - Constructor for class org.apache.beam.runners.flink.translation.utils.CountingPipelineVisitor

create(FlinkJobServerDriver.FlinkServerConfiguration) - Static method in class org.apache.beam.runners.flink.FlinkJobInvoker

create(boolean) - Static method in class org.apache.beam.runners.flink.TestFlinkRunner

create(Output<StreamRecord<WindowedValue<OutputT>>>, Lock, OperatorStateBackend) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.MultiOutputOutputManagerFactory

create(DoFnRunner<InputT, OutputT>, String, Coder, Coder, OperatorStateBackend, KeyedStateBackend<Object>, int, SerializablePipelineOptions) - Static method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

createBatchExecutionEnvironment(FlinkPipelineOptions, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkExecutionEnvironments

If the submitted job is a batch processing job, this method creates the adequate Flink ExecutionEnvironment depending on the user-specified options.

createComparator(boolean, ExecutionConfig) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

createComparator(boolean, ExecutionConfig) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

createInputSplits(int) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

createInputSplits(int) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

createInstance() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

createInstance() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

createJobInvocation(String, String, ListeningExecutorService, RunnerApi.Pipeline, FlinkPipelineOptions, PortablePipelineRunner) - Method in class org.apache.beam.runners.flink.FlinkJobInvoker

createSerializer(ExecutionConfig) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

createSerializer(ExecutionConfig) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

createStateBackend(FlinkPipelineOptions) - Method in interface org.apache.beam.runners.flink.FlinkStateBackendFactory

createStreamExecutionEnvironment(FlinkPipelineOptions, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkExecutionEnvironments

If the submitted job is a stream processing job, this method creates the adequate Flink StreamExecutionEnvironment depending on the user-specified options.

createTranslationContext(JobInfo, FlinkPipelineOptions, String, List<String>) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator

Creates a batch translation context.

createTranslationContext(JobInfo, FlinkPipelineOptions, String, List<String>) - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

createTranslationContext(JobInfo, FlinkPipelineOptions, String, List<String>) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator

Creates a streaming translation context.

createTranslator() - Static method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator

Creates a batch translator.

createWrappingDoFnRunner(DoFnRunner<InputT, OutputT>, StepContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

createWrappingDoFnRunner(DoFnRunner<InputT, OutputT>, StepContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

createWrappingDoFnRunner(DoFnRunner<KeyedWorkItem<byte[], KV<InputT, RestrictionT>>, OutputT>, StepContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SplittableDoFnOperator

createWrappingDoFnRunner(DoFnRunner<KeyedWorkItem<K, InputT>, KV<K, OutputT>>, StepContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator

D

DataInputViewWrapper - Class in org.apache.beam.runners.flink.translation.wrappers

Wrapper for DataInputView.

DataInputViewWrapper(DataInputView) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.DataInputViewWrapper

DataOutputViewWrapper - Class in org.apache.beam.runners.flink.translation.wrappers

Wrapper for DataOutputView.

DataOutputViewWrapper(DataOutputView) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.DataOutputViewWrapper

decode(InputStream) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

decode(InputStream, Coder.Context) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

decodeKey(ByteBuffer, Coder<K>) - Static method in class org.apache.beam.runners.flink.translation.wrappers.streaming.FlinkKeyUtils

Decodes a key from a ByteBuffer containing a byte array.

DedupingOperator<T> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.io

Remove values with duplicate ids.

DedupingOperator(PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

defaults() - Static method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

deleteStaticCaches() - Static method in class org.apache.beam.runners.flink.translation.utils.Workarounds

deserialize(DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

deserialize(T, DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

deserialize(DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

deserialize(byte[], DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

dispose() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.AbstractStreamOperatorCompat

doFn - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

DoFnOperator<InputT,OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Flink operator for executing DoFns.

DoFnOperator(DoFn<InputT, OutputT>, String, Coder<WindowedValue<InputT>>, Map<TupleTag<?>, Coder<?>>, TupleTag<OutputT>, List<TupleTag<?>>, DoFnOperator.OutputManagerFactory<OutputT>, WindowingStrategy<?, ?>, Map<Integer, PCollectionView<?>>, Collection<PCollectionView<?>>, PipelineOptions, Coder<?>, KeySelector<WindowedValue<InputT>, ?>, DoFnSchemaInformation, Map<String, PCollectionView<?>>) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

Constructor for DoFnOperator.

DoFnOperator.BufferedOutputManager<OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

A DoFnRunners.OutputManager that can buffer its outputs.

DoFnOperator.FlinkStepContext - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

StepContext for running DoFns on Flink.

DoFnOperator.MultiOutputOutputManagerFactory<OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Implementation of OutputManagerFactory that creates an DoFnOperator.BufferedOutputManager that can write to multiple logical outputs by Flink side output.

doFnRunner - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

DoFnRunnerWithMetricsUpdate<InputT,OutputT> - Class in org.apache.beam.runners.flink.metrics

DoFnRunner decorator which registers MetricsContainerImpl.

DoFnRunnerWithMetricsUpdate(String, DoFnRunner<InputT, OutputT>, FlinkMetricContainer) - Constructor for class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

duplicate() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

duplicate() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

E

EarlyBinder(KeyedStateBackend, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals.EarlyBinder

elementsIterable() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItem

encode(KeyedWorkItem<K, ElemT>, OutputStream) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

encode(KeyedWorkItem<K, ElemT>, OutputStream, Coder.Context) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

EncodedValueComparator - Class in org.apache.beam.runners.flink.translation.types

Flink TypeComparator for Beam values that have been encoded to byte data by a Coder.

EncodedValueComparator(boolean) - Constructor for class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

EncodedValueSerializer - Class in org.apache.beam.runners.flink.translation.types

TypeSerializer for values that were encoded using a Coder.

EncodedValueSerializer() - Constructor for class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

EncodedValueTypeInformation - Class in org.apache.beam.runners.flink.translation.types

Flink TypeInformation for Beam values that have been encoded to byte data by a Coder.

EncodedValueTypeInformation() - Constructor for class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

encodeKey(K, Coder<K>) - Static method in class org.apache.beam.runners.flink.translation.wrappers.streaming.FlinkKeyUtils

Encodes a key to a byte array wrapped inside a ByteBuffer.

enterCompositeTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

equals(Object) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

equals(Object) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

equals(Object) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

equalToReference(byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

EXACTLY_ONCE - Static variable in interface org.apache.beam.runners.flink.FlinkPipelineOptions

ExecutableStageDoFnOperator<InputT,OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

This operator is the streaming equivalent of the FlinkExecutableStageFunction.

ExecutableStageDoFnOperator(String, Coder<WindowedValue<InputT>>, Map<TupleTag<?>, Coder<?>>, TupleTag<OutputT>, List<TupleTag<?>>, DoFnOperator.OutputManagerFactory<OutputT>, Map<Integer, PCollectionView<?>>, Collection<PCollectionView<?>>, Map<RunnerApi.ExecutableStagePayload.SideInputId, PCollectionView<?>>, PipelineOptions, RunnerApi.ExecutableStagePayload, JobInfo, FlinkExecutableStageContextFactory, Map<String, TupleTag<?>>, WindowingStrategy, Coder, KeySelector<WindowedValue<InputT>, ?>) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

Constructor.

execute(String) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

execute(String) - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator.Executor

execute(String) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

extractKeys(Object, Object[], int) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

extractOutput(K, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.CompleteFlinkCombiner

extractOutput(K, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FinalFlinkCombiner

extractOutput(K, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in interface org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FlinkCombiner

extractOutput(K, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.PartialFlinkCombiner

F

FileReporter - Class in org.apache.beam.runners.flink.metrics

Flink metrics reporter for writing metrics to a file specified via the "metrics.reporter.file.path" config key (assuming an alias of "file" for this reporter in the "metrics.reporters" setting).

FileReporter() - Constructor for class org.apache.beam.runners.flink.metrics.FileReporter

filterCharacters(String) - Method in class org.apache.beam.runners.flink.metrics.FileReporter

FinalFlinkCombiner(CombineFnBase.GlobalCombineFn<?, AccumT, OutputT>) - Constructor for class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FinalFlinkCombiner

finishBundle() - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

finishBundle() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

fireTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

fireTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SplittableDoFnOperator

fireTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator

fireTimerInternal(ByteBuffer, TimerInternals.TimerData) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

fireTimerInternal(ByteBuffer, TimerInternals.TimerData) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

firstInput(K, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.CompleteFlinkCombiner

firstInput(K, AccumT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FinalFlinkCombiner

firstInput(K, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in interface org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.FlinkCombiner

firstInput(K, InputT, PipelineOptions, SideInputReader, Collection<? extends BoundedWindow>) - Method in class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.PartialFlinkCombiner

flatMap(WindowedValue<T>, Collector<WindowedValue<T>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkAssignWindows

flatMap(WindowedValue<InputT>, Collector<WindowedValue<RawUnionValue>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction

flatMap(RawUnionValue, Collector<WindowedValue<?>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStagePruningFunction

flatMap(WindowedValue<T>, Collector<WindowedValue<T>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExplodeWindowsFunction

flatMap(WindowedValue<RawUnionValue>, Collector<WindowedValue<T>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkMultiOutputPruningFunction

FlinkAssignWindows<T,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

Flink FlatMapFunction for implementing Window.Assign.

FlinkAssignWindows(WindowFn<T, W>) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkAssignWindows

FlinkBatchPortablePipelineTranslator - Class in org.apache.beam.runners.flink

A translator that translates bounded portable pipelines into executable Flink pipelines.

FlinkBatchPortablePipelineTranslator.BatchTranslationContext - Class in org.apache.beam.runners.flink

Batch translation context.

FlinkBatchPortablePipelineTranslator.IsFlinkNativeTransform - Class in org.apache.beam.runners.flink

Predicate to determine whether a URN is a Flink native transform.

FlinkBroadcastStateInternals<K> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.state

StateInternals that uses a Flink OperatorStateBackend to manage the broadcast state.

FlinkBroadcastStateInternals(int, OperatorStateBackend, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkBroadcastStateInternals

FlinkDetachedRunnerResult - Class in org.apache.beam.runners.flink

Result of a detached execution of a Pipeline with Flink.

FlinkDoFnFunction<InputT,OutputT> - Class in org.apache.beam.runners.flink.translation.functions

Encapsulates a DoFn inside a Flink RichMapPartitionFunction.

FlinkDoFnFunction(DoFn<InputT, OutputT>, String, WindowingStrategy<?, ?>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions, Map<TupleTag<?>, Integer>, TupleTag<OutputT>, Coder<InputT>, Map<TupleTag<?>, Coder<?>>, DoFnSchemaInformation, Map<String, PCollectionView<?>>) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction

FlinkExecutableStageContextFactory - Class in org.apache.beam.runners.flink.translation.functions

Singleton class that contains one ExecutableStageContext.Factory per job.

FlinkExecutableStageFunction<InputT> - Class in org.apache.beam.runners.flink.translation.functions

Flink operator that passes its input DataSet through an SDK-executed ExecutableStage.

FlinkExecutableStageFunction(String, PipelineOptions, RunnerApi.ExecutableStagePayload, JobInfo, Map<String, Integer>, FlinkExecutableStageContextFactory, Coder, Coder<WindowedValue<InputT>>) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction

FlinkExecutableStagePruningFunction - Class in org.apache.beam.runners.flink.translation.functions

A Flink function that demultiplexes output from a FlinkExecutableStageFunction.

FlinkExecutableStagePruningFunction(int, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStagePruningFunction

Creates a FlinkExecutableStagePruningFunction that extracts elements of the given union tag.

FlinkExecutionEnvironments - Class in org.apache.beam.runners.flink

Utilities for Flink execution environments.

FlinkExecutionEnvironments() - Constructor for class org.apache.beam.runners.flink.FlinkExecutionEnvironments

FlinkExplodeWindowsFunction<T> - Class in org.apache.beam.runners.flink.translation.functions

Explode WindowedValue that belongs to multiple windows into multiple "single window" values, so we can safely group elements by (K, W) tuples.

FlinkExplodeWindowsFunction() - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkExplodeWindowsFunction

FlinkIdentityFunction<T> - Class in org.apache.beam.runners.flink.translation.functions

A map function that outputs the input element without any change.

FlinkJobInvoker - Class in org.apache.beam.runners.flink

Job Invoker for the FlinkRunner.

FlinkJobInvoker(FlinkJobServerDriver.FlinkServerConfiguration) - Constructor for class org.apache.beam.runners.flink.FlinkJobInvoker

FlinkJobServerDriver - Class in org.apache.beam.runners.flink

Driver program that starts a job server for the Flink runner.

FlinkJobServerDriver.FlinkServerConfiguration - Class in org.apache.beam.runners.flink

Flink runner-specific Configuration for the jobServer.

FlinkKeyUtils - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Utility functions for dealing with key encoding.

FlinkKeyUtils() - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.FlinkKeyUtils

FlinkMergingNonShuffleReduceFunction<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

Special version of FlinkReduceFunction that supports merging windows.

FlinkMergingNonShuffleReduceFunction(CombineFnBase.GlobalCombineFn<InputT, AccumT, OutputT>, WindowingStrategy<Object, W>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkMergingNonShuffleReduceFunction

FlinkMetricContainer - Class in org.apache.beam.runners.flink.metrics

Helper class for holding a MetricsContainerImpl and forwarding Beam metrics to Flink accumulators and metrics.

FlinkMetricContainer(RuntimeContext) - Constructor for class org.apache.beam.runners.flink.metrics.FlinkMetricContainer

FlinkMetricContainer.FlinkDistributionGauge - Class in org.apache.beam.runners.flink.metrics

Flink Gauge for DistributionResult.

FlinkMetricContainer.FlinkGauge - Class in org.apache.beam.runners.flink.metrics

Flink Gauge for GaugeResult.

FlinkMiniClusterEntryPoint - Class in org.apache.beam.runners.flink

Entry point for starting an embedded Flink cluster.

FlinkMiniClusterEntryPoint() - Constructor for class org.apache.beam.runners.flink.FlinkMiniClusterEntryPoint

FlinkMultiOutputPruningFunction<T> - Class in org.apache.beam.runners.flink.translation.functions

A FlatMapFunction function that filters out those elements that don't belong in this output.

FlinkMultiOutputPruningFunction(int, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkMultiOutputPruningFunction

FlinkNonMergingReduceFunction<K,InputT> - Class in org.apache.beam.runners.flink.translation.functions

Reduce function for non-merging GBK implementation.

FlinkNonMergingReduceFunction(WindowingStrategy<?, ?>, boolean) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkNonMergingReduceFunction

FlinkNoOpStepContext - Class in org.apache.beam.runners.flink.translation.functions

A StepContext for Flink Batch Runner execution.

FlinkNoOpStepContext() - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkNoOpStepContext

FlinkPartialReduceFunction<K,InputT,AccumT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

This is is the first step for executing a Combine.PerKey on Flink.

FlinkPartialReduceFunction(CombineFnBase.GlobalCombineFn<InputT, AccumT, ?>, WindowingStrategy<Object, W>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

FlinkPartialReduceFunction(CombineFnBase.GlobalCombineFn<InputT, AccumT, ?>, WindowingStrategy<Object, W>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions, boolean) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

FlinkPipelineOptions - Interface in org.apache.beam.runners.flink

Options which can be used to configure the Flink Runner.

FlinkPipelineRunner - Class in org.apache.beam.runners.flink

Runs a Pipeline on Flink via FlinkRunner.

FlinkPipelineRunner(FlinkPipelineOptions, String, List<String>) - Constructor for class org.apache.beam.runners.flink.FlinkPipelineRunner

FlinkPortableClientEntryPoint - Class in org.apache.beam.runners.flink

Flink job entry point to launch a Beam pipeline by executing an external SDK driver program.

FlinkPortableClientEntryPoint(String) - Constructor for class org.apache.beam.runners.flink.FlinkPortableClientEntryPoint

FlinkPortablePipelineTranslator<T extends FlinkPortablePipelineTranslator.TranslationContext> - Interface in org.apache.beam.runners.flink

Interface for portable Flink translators.

FlinkPortablePipelineTranslator.Executor - Interface in org.apache.beam.runners.flink

A handle used to execute a translated pipeline.

FlinkPortablePipelineTranslator.TranslationContext - Interface in org.apache.beam.runners.flink

The context used for pipeline translation.

FlinkPortableRunnerResult - Class in org.apache.beam.runners.flink

Result of executing a portable Pipeline with Flink.

FlinkPortableRunnerUtils - Class in org.apache.beam.runners.flink.translation.utils

Various utilies related to portability.

FlinkReduceFunction<K,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

This is the second part for executing a Combine.PerKey on Flink, the second part is FlinkReduceFunction.

FlinkReduceFunction(CombineFnBase.GlobalCombineFn<?, AccumT, OutputT>, WindowingStrategy<Object, W>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

FlinkReduceFunction(CombineFnBase.GlobalCombineFn<?, AccumT, OutputT>, WindowingStrategy<Object, W>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions, boolean) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

FlinkRunner - Class in org.apache.beam.runners.flink

A PipelineRunner that executes the operations in the pipeline by first translating them to a Flink Plan and then executing them either locally or on a Flink cluster, depending on the configuration.

FlinkRunner(FlinkPipelineOptions) - Constructor for class org.apache.beam.runners.flink.FlinkRunner

FlinkRunnerRegistrar - Class in org.apache.beam.runners.flink

AutoService registrar - will register FlinkRunner and FlinkOptions as possible pipeline runner services.

FlinkRunnerRegistrar.Options - Class in org.apache.beam.runners.flink

Pipeline options registrar.

FlinkRunnerRegistrar.Runner - Class in org.apache.beam.runners.flink

Pipeline runner registrar.

FlinkRunnerResult - Class in org.apache.beam.runners.flink

Result of executing a Pipeline with Flink.

FlinkServerConfiguration() - Constructor for class org.apache.beam.runners.flink.FlinkJobServerDriver.FlinkServerConfiguration

FlinkSideInputReader - Class in org.apache.beam.runners.flink.translation.functions

A SideInputReader for the Flink Batch Runner.

FlinkSideInputReader(Map<PCollectionView<?>, WindowingStrategy<?, ?>>, RuntimeContext) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkSideInputReader

FlinkStateBackendFactory - Interface in org.apache.beam.runners.flink

Constructs a StateBackend to use from flink pipeline options.

FlinkStatefulDoFnFunction<K,V,OutputT> - Class in org.apache.beam.runners.flink.translation.functions

A RichGroupReduceFunction for stateful ParDo in Flink Batch Runner.

FlinkStatefulDoFnFunction(DoFn<KV<K, V>, OutputT>, String, WindowingStrategy<?, ?>, Map<PCollectionView<?>, WindowingStrategy<?, ?>>, PipelineOptions, Map<TupleTag<?>, Integer>, TupleTag<OutputT>, Coder<KV<K, V>>, Map<TupleTag<?>, Coder<?>>, DoFnSchemaInformation, Map<String, PCollectionView<?>>) - Constructor for class org.apache.beam.runners.flink.translation.functions.FlinkStatefulDoFnFunction

FlinkStateInternals<K> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.state

StateInternals that uses a Flink KeyedStateBackend to manage state.

FlinkStateInternals(KeyedStateBackend<ByteBuffer>, Coder<K>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

FlinkStateInternals.EarlyBinder - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.state

Eagerly create user state to work around https://jira.apache.org/jira/browse/FLINK-12653.

FlinkStepContext() - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.FlinkStepContext

FlinkStreamingPortablePipelineTranslator - Class in org.apache.beam.runners.flink

Translate an unbounded portable pipeline representation into a Flink pipeline representation.

FlinkStreamingPortablePipelineTranslator.IsFlinkNativeTransform - Class in org.apache.beam.runners.flink

Predicate to determine whether a URN is a Flink native transform.

FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext - Class in org.apache.beam.runners.flink

Streaming translation context.

flushData() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

fromConfig(FlinkJobServerDriver.FlinkServerConfiguration) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver

fromConfig(FlinkJobServerDriver.FlinkServerConfiguration, JobServerDriver.JobInvokerFactory) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver

fromOptions(PipelineOptions) - Static method in class org.apache.beam.runners.flink.FlinkRunner

Construct a runner from the provided options.

fromOptions(PipelineOptions) - Static method in class org.apache.beam.runners.flink.TestFlinkRunner

fromParams(String[]) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver

G

get(JobInfo) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageContextFactory

get(PCollectionView<T>, BoundedWindow) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkSideInputReader

getAllowNonRestoredState() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getArity() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

getArity() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

getAutoWatermarkInterval() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getBundleFinalizer() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

getCheckpointingInterval() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getCheckpointingMode() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getCheckpointTimeoutMillis() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getCoder() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

getCoderArguments() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

getCurrentKey() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

getCurrentOutputWatermark() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

getDanglingDataSets() - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

getDataSetOrThrow(String) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

getDataStreamOrThrow(String) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

getDisableMetrics() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getDoFn() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

getDoFn() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator

getEffectiveInputWatermark() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

getElementCoder() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

getElements() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.KeyedBufferingElementsHandler

getElements() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.NonKeyedBufferingElementsHandler

getExecutionEnvironment() - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

getExecutionEnvironment() - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

getExecutionModeForBatch() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getExecutionRetryDelay() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getFailOnCheckpointingErrors() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getFasterCopy() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getFinishBundleBeforeCheckpointing() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getFlatComparators() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

getFlinkMaster() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

The url of the Flink JobManager on which to execute pipelines.

getFn() - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

getFn() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

getInput(PTransform<T, ?>) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

getInputs(PTransform<?, ?>) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

getInputSplitAssigner(GenericInputSplit[]) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

getInputSplitAssigner(SourceInputSplit[]) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

getInstance() - Static method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageContextFactory

getJobInfo() - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

getJobInfo() - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator.TranslationContext

getJobInfo() - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

getKey(WindowedValue<KV<K, InputT>>) - Method in class org.apache.beam.runners.flink.translation.types.KvKeySelector

getKey(WindowedValue<KV<K, InputT>>) - Method in class org.apache.beam.runners.flink.translation.types.WindowedKvKeySelector

getKey(WindowedValue<KV<K, V>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.KvToByteBufferKeySelector

getKey(WindowedValue<KV<KV<K, V>, Double>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SdfByteBufferKeySelector

getKey() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkBroadcastStateInternals

getKey() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

getKey(WindowedValue<KeyedWorkItem<K, V>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.WorkItemKeySelector

getKeyCoder() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

getLatencyTrackingInterval() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getLength() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

getLength() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

getLocalValue() - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator

getLockToAcquireForStateAccessDuringBundles() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

Subclasses may provide a lock to ensure that the state backend is not accessed concurrently during bundle execution.

getLockToAcquireForStateAccessDuringBundles() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

getMaxBundleSize() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getMaxBundleTimeMills() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getMaxParallelism() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getMetricsContainer(String) - Method in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer

getMinPauseBetweenCheckpoints() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getNormalizeKeyLen() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

getNumberOfExecutionRetries() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getNumConcurrentCheckpoints() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getNumConsumers(PValue) - Method in class org.apache.beam.runners.flink.translation.utils.CountingPipelineVisitor

Calculate number of consumers of a given PValue.

getObjectReuse() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getOutput(PTransform<?, T>) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

getOutputCoders(PTransform<?, ?>) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

getOutputs(PTransform<?, ?>) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

getParallelism() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getPipelineOptions() - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext

getPipelineOptions() - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator.TranslationContext

getPipelineOptions() - Method in class org.apache.beam.runners.flink.FlinkRunner

For testing.

getPipelineOptions() - Method in class org.apache.beam.runners.flink.FlinkRunnerRegistrar.Options

getPipelineOptions() - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext

getPipelineOptions() - Method in class org.apache.beam.runners.flink.TestFlinkRunner

getPipelineRunners() - Method in class org.apache.beam.runners.flink.FlinkRunnerRegistrar.Runner

getProducedType() - Method in class org.apache.beam.runners.flink.translation.types.KvKeySelector

getProducedType() - Method in class org.apache.beam.runners.flink.translation.types.WindowedKvKeySelector

getProducedType() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.KvToByteBufferKeySelector

getProducedType() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SdfByteBufferKeySelector

getProducedType() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.WorkItemKeySelector

getReIterableGroupByKeyResult() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getReportCheckpointDuration() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getRetainExternalizedCheckpointsOnCancellation() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getSavepointPath() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getShutdownSourcesAfterIdleMs() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getSource() - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputSplit

getSplitNumber() - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputSplit

getSplitSources() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

Visible so that we can check this in tests.

getState() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

getState() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

getStateBackend() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getStateBackendFactory() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

Deprecated.

Please use setStateBackend below.

getStateBackendStoragePath() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

getStatistics(BaseStatistics) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

getStatistics(BaseStatistics) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

getTimeServiceManagerCompat() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.AbstractStreamOperatorCompat

getTotalFields() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

getTotalFields() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

getTypeClass() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

getTypeClass() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

getValue() - Method in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer.FlinkDistributionGauge

getValue() - Method in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer.FlinkGauge

getVersion() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer.LegacySnapshot

H

hash(byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

hashCode() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

hashCode() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

hashCode() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

HashingFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

A Flink combine runner that builds a map of merged windows and produces output after seeing all input.

HashingFlinkCombineRunner() - Constructor for class org.apache.beam.runners.flink.translation.functions.HashingFlinkCombineRunner

I

ImpulseInputFormat - Class in org.apache.beam.runners.flink.translation.wrappers

Flink input format that implements impulses.

ImpulseInputFormat() - Constructor for class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

ImpulseSourceFunction - Class in org.apache.beam.runners.flink.translation.functions

Source function which sends a single global impulse to a downstream operator.

ImpulseSourceFunction(long) - Constructor for class org.apache.beam.runners.flink.translation.functions.ImpulseSourceFunction

initializeBroadcastVariable(Iterable<WindowedValue<?>>) - Method in class org.apache.beam.runners.flink.translation.functions.SideInputInitializer

initializeState(FunctionInitializationContext) - Method in class org.apache.beam.runners.flink.translation.functions.ImpulseSourceFunction

initializeState(StateInitializationContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

initializeState(StateInitializationContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

initializeState(FunctionInitializationContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

initializeState(StateInitializationContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SplittableDoFnOperator

invertNormalizedKey() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

invokeAdvance(ReaderT) - Method in class org.apache.beam.runners.flink.metrics.ReaderInvocationUtil

invokeFinishBundle() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

invokeStart(ReaderT) - Method in class org.apache.beam.runners.flink.metrics.ReaderInvocationUtil

invokeWithExecutor(RunnerApi.Pipeline, Struct, String, ListeningExecutorService) - Method in class org.apache.beam.runners.flink.FlinkJobInvoker

isAutoBalanceWriteFilesShardingEnabled() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

isBasicType() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

isBasicType() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

isEmpty() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkSideInputReader

isExternalizedCheckpointsEnabled() - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

Enables or disables externalized checkpoints.

IsFlinkNativeTransform() - Constructor for class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.IsFlinkNativeTransform

IsFlinkNativeTransform() - Constructor for class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.IsFlinkNativeTransform

isImmutableType() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

isImmutableType() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

isKeyType() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

isKeyType() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

isNormalizedKeyPrefixOnly(int) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

isTupleType() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

isTupleType() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

K

key() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItem

keyCoder - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

KeyedBufferingElementsHandler - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput

A keyed implementation of a BufferingElementsHandler.

keyedStateInternals - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

knownUrns() - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator

knownUrns() - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

knownUrns() - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator

KvKeySelector<InputT,K> - Class in org.apache.beam.runners.flink.translation.types

KeySelector that extracts the key from a KV and returns it in encoded form as a byte array.

KvKeySelector(Coder<K>) - Constructor for class org.apache.beam.runners.flink.translation.types.KvKeySelector

KvToByteBufferKeySelector<K,V> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

KeySelector that retrieves a key from a KV.

KvToByteBufferKeySelector(Coder<K>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.KvToByteBufferKeySelector

L

LegacySnapshot() - Constructor for class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer.LegacySnapshot

Needs to be public to work with VersionedIOReadableWritable.

LegacySnapshot(CoderTypeSerializer<T>) - Constructor for class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer.LegacySnapshot

LookupPipelineVisitor - Class in org.apache.beam.runners.flink.translation.utils

Pipeline visitor that fills lookup table of PTransform to AppliedPTransform for usage in FlinkBatchPortablePipelineTranslator.BatchTranslationContext.

LookupPipelineVisitor() - Constructor for class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

M

main(String[]) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver

main(String[]) - Static method in class org.apache.beam.runners.flink.FlinkMiniClusterEntryPoint

main(String[]) - Static method in class org.apache.beam.runners.flink.FlinkPipelineRunner

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

main(String[]) - Static method in class org.apache.beam.runners.flink.FlinkPortableClientEntryPoint

Main method to be called standalone or by Flink (CLI or REST API).

mainOutputTag - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

map(T) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkIdentityFunction

mapPartition(Iterable<WindowedValue<InputT>>, Collector<RawUnionValue>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction

For non-stateful processing via a simple MapPartitionFunction.

merge(Accumulator<MetricsContainerStepMap, MetricsContainerStepMap>) - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator

metrics() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

metrics() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

Metrics - Class in org.apache.beam.runners.flink.metrics

Helper for pretty-printing Flink metrics.

Metrics() - Constructor for class org.apache.beam.runners.flink.metrics.Metrics

MetricsAccumulator - Class in org.apache.beam.runners.flink.metrics

Accumulator of MetricsContainerStepMap.

MetricsAccumulator() - Constructor for class org.apache.beam.runners.flink.metrics.MetricsAccumulator

minWatermarkHoldMs() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

Returns the minimum over all watermark holds.

MultiOutputOutputManagerFactory(TupleTag<OutputT>, Coder<WindowedValue<OutputT>>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.MultiOutputOutputManagerFactory

MultiOutputOutputManagerFactory(TupleTag<OutputT>, Map<TupleTag<?>, OutputTag<WindowedValue<?>>>, Map<TupleTag<?>, Coder<WindowedValue<?>>>, Map<TupleTag<?>, Integer>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.MultiOutputOutputManagerFactory

N

nextRecord(WindowedValue<byte[]>) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

nextRecord(WindowedValue<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

NonKeyedBufferingElementsHandler<T> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput

A non-keyed implementation of a BufferingElementsHandler.

notifyCheckpointComplete(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

notifyCheckpointComplete(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

notifyCheckpointComplete(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

notifyOfRemovedMetric(Metric, String, MetricGroup) - Method in class org.apache.beam.runners.flink.metrics.FileReporter

O

of() - Static method in class org.apache.beam.runners.flink.translation.functions.FlinkIdentityFunction

of(Coder<K>, Coder<ElemT>, Coder<? extends BoundedWindow>) - Static method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

Create a new KeyedWorkItemCoder with the provided key coder, element coder, and window coder.

onEventTime(InternalTimer<ByteBuffer, TimerInternals.TimerData>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

onEventTime(InternalTimer<ByteBuffer, VoidNamespace>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

onProcessingTime(InternalTimer<ByteBuffer, TimerInternals.TimerData>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

onProcessingTime(InternalTimer<ByteBuffer, VoidNamespace>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

onProcessingTime(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

onTimer(String, String, KeyT, BoundedWindow, Instant, Instant, TimeDomain) - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

onTimer(String, String, KeyT, BoundedWindow, Instant, Instant, TimeDomain) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

onWindowExpiration(BoundedWindow, Instant, KeyT) - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

onWindowExpiration(BoundedWindow, Instant, KeyT) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

open(MetricConfig) - Method in class org.apache.beam.runners.flink.metrics.FileReporter

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStagePruningFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkMergingNonShuffleReduceFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkMultiOutputPruningFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkStatefulDoFnFunction

open(GenericInputSplit) - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

open(SourceInputSplit<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

open() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

open() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

open() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

open(Configuration) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

Initialize and restore state before starting execution of the source.

Options() - Constructor for class org.apache.beam.runners.flink.FlinkRunnerRegistrar.Options

org.apache.beam.runners.flink - package org.apache.beam.runners.flink

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.metrics - package org.apache.beam.runners.flink.metrics

Internal metrics implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.functions - package org.apache.beam.runners.flink.translation.functions

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.types - package org.apache.beam.runners.flink.translation.types

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.utils - package org.apache.beam.runners.flink.translation.utils

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.wrappers - package org.apache.beam.runners.flink.translation.wrappers

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.wrappers.streaming - package org.apache.beam.runners.flink.translation.wrappers.streaming

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.wrappers.streaming.io - package org.apache.beam.runners.flink.translation.wrappers.streaming.io

Internal implementation of the Beam runner for Apache Flink.

org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput - package org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput

Classes for buffering elements for achieving @RequiresStableInput.

org.apache.beam.runners.flink.translation.wrappers.streaming.state - package org.apache.beam.runners.flink.translation.wrappers.streaming.state

Internal state implementation of the Beam runner for Apache Flink.

output - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.BufferedOutputManager

output(TupleTag<T>, WindowedValue<T>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.BufferedOutputManager

outputManager - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

outputManagerFactory - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

P

parseArgs(String[]) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver

PartialFlinkCombiner(CombineFnBase.GlobalCombineFn<InputT, AccumT, ?>) - Constructor for class org.apache.beam.runners.flink.translation.functions.AbstractFlinkCombineRunner.PartialFlinkCombiner

PIPELINED - Static variable in interface org.apache.beam.runners.flink.FlinkPipelineOptions

portableMetrics() - Method in class org.apache.beam.runners.flink.FlinkPortableRunnerResult

prepareSnapshotPreBarrier(long) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processElement(WindowedValue<InputT>) - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

processElement(StreamRecord<WindowedValue<InputT>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processElement(StreamRecord<WindowedValue<ValueWithRecordId<T>>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.DedupingOperator

processElement(WindowedValue<InputT>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

processElement1(StreamRecord<WindowedValue<InputT>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processElement2(StreamRecord<RawUnionValue>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processWatermark(Watermark) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processWatermark1(Watermark) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processWatermark2(Watermark) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

processWith(DoFnRunner<InputT, OutputT>) - Method in interface org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferedElement

Processes this element with the provided DoFnRunner.

pushbackDoFnRunner - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

putNormalizedKey(byte[], MemorySegment, int, int) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

R

reachedEnd() - Method in class org.apache.beam.runners.flink.translation.wrappers.ImpulseInputFormat

reachedEnd() - Method in class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

read() - Method in class org.apache.beam.runners.flink.translation.wrappers.DataInputViewWrapper

read(byte[], int, int) - Method in class org.apache.beam.runners.flink.translation.wrappers.DataInputViewWrapper

ReaderInvocationUtil<OutputT,ReaderT extends org.apache.beam.sdk.io.Source.Reader<OutputT>> - Class in org.apache.beam.runners.flink.metrics

Util for invoking Source.Reader methods that might require a MetricsContainerImpl to be active.

ReaderInvocationUtil(String, PipelineOptions, FlinkMetricContainer) - Constructor for class org.apache.beam.runners.flink.metrics.ReaderInvocationUtil

readWithKeyDenormalization(byte[], DataInputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

reduce(Iterable<WindowedValue<InputT>>, Collector<RawUnionValue>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction

For stateful and timer processing via a GroupReduceFunction.

reduce(Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkMergingNonShuffleReduceFunction

reduce(Iterable<WindowedValue<KV<K, InputT>>>, Collector<WindowedValue<KV<K, Iterable<InputT>>>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkNonMergingReduceFunction

reduce(Iterable<WindowedValue<KV<K, AccumT>>>, Collector<WindowedValue<KV<K, OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

reduce(Iterable<WindowedValue<KV<K, V>>>, Collector<WindowedValue<RawUnionValue>>) - Method in class org.apache.beam.runners.flink.translation.functions.FlinkStatefulDoFnFunction

registerMetricsForPipelineResult() - Method in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer

This should be called at the end of the Flink job and sets up an accumulator to push the metrics to the PipelineResult.

removeWatermarkHoldUsage(Instant) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

reportCheckpointDuration(long) - Method in class org.apache.beam.runners.flink.translation.utils.CheckpointStats

requiresTimeSortedInput(RunnerApi.ExecutableStagePayload, boolean) - Static method in class org.apache.beam.runners.flink.translation.utils.FlinkPortableRunnerUtils

resetLocal() - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator

resolveSchemaCompatibility(TypeSerializer<T>) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer.LegacySnapshot

retrieveInternalProcessingTimerQueue(InternalTimerService<TimerInternals.TimerData>) - Static method in class org.apache.beam.runners.flink.translation.utils.Workarounds

run(RunnerApi.Pipeline, JobInfo) - Method in class org.apache.beam.runners.flink.FlinkPipelineRunner

run(Pipeline) - Method in class org.apache.beam.runners.flink.FlinkRunner

run(Pipeline) - Method in class org.apache.beam.runners.flink.TestFlinkRunner

run(SourceFunction.SourceContext<WindowedValue<byte[]>>) - Method in class org.apache.beam.runners.flink.translation.functions.ImpulseSourceFunction

run(SourceFunction.SourceContext<WindowedValue<byte[]>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.StreamingImpulseSource

Deprecated.

run(SourceFunction.SourceContext<WindowedValue<T>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.TestStreamSource

run(SourceFunction.SourceContext<WindowedValue<ValueWithRecordId<OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

Runner() - Constructor for class org.apache.beam.runners.flink.FlinkRunnerRegistrar.Runner

S

SdfByteBufferKeySelector<K,V> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

KeySelector that retrieves a key from a KV<KV<element, KV<restriction, watermarkState>>, size>.

SdfByteBufferKeySelector(Coder<K>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.SdfByteBufferKeySelector

serialize(T, DataOutputView) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

serialize(byte[], DataOutputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

serializedOptions - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

serializedOptions - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

serializedOptions - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

setAllowNonRestoredState(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setAutoBalanceWriteFilesShardingEnabled(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setAutoWatermarkInterval(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setBundleFinishedCallback(Runnable) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

setCheckpointingInterval(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setCheckpointingMode(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setCheckpointTimeoutMillis(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setCurrentKey(Object) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

We don't want to set anything here.

setDisableMetrics(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setExecutionModeForBatch(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setExecutionRetryDelay(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setExternalizedCheckpointsEnabled(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setFailOnCheckpointingErrors(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setFasterCopy(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setFinishBundleBeforeCheckpointing(boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setFlinkMaster(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setKeyContextElement1(StreamRecord) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator

Note: This is only relevant when we have a stateful DoFn.

setLatencyTrackingInterval(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setMaxBundleSize(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setMaxBundleTimeMills(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setMaxParallelism(Integer) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setMinPauseBetweenCheckpoints(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setNumberOfExecutionRetries(Integer) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setNumConcurrentCheckpoints(int) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setObjectReuse(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setParallelism(Integer) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setPreBundleCallback(Runnable) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

setReference(byte[]) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

setReIterableGroupByKeyResult(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setReportCheckpointDuration(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setRetainExternalizedCheckpointsOnCancellation(Boolean) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setSavepointPath(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setShutdownSourcesAfterIdleMs(Long) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setSourceContext(SourceFunction.SourceContext<WindowedValue<ValueWithRecordId<OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

Visible so that we can set this in tests.

setStateBackend(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setStateBackendFactory(Class<? extends FlinkStateBackendFactory>) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

Deprecated.

Please use setStateBackend below.

setStateBackendStoragePath(String) - Method in interface org.apache.beam.runners.flink.FlinkPipelineOptions

setup(StreamTask<?, ?>, StreamConfig, Output<StreamRecord<WindowedValue<OutputT>>>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

sideInputHandler - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

SideInputInitializer<ViewT> - Class in org.apache.beam.runners.flink.translation.functions

BroadcastVariableInitializer that initializes the broadcast input as a Map from window to side input.

SideInputInitializer(PCollectionView<ViewT>) - Constructor for class org.apache.beam.runners.flink.translation.functions.SideInputInitializer

sideInputReader - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

sideInputs - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

sideInputs - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

sideInputs - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

sideInputTagMapping - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

SingletonKeyedWorkItem<K,ElemT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Singleton keyed word item.

SingletonKeyedWorkItem(K, WindowedValue<ElemT>) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItem

SingletonKeyedWorkItemCoder<K,ElemT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Singleton keyed work item coder.

SingleWindowFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

A Flink combine runner takes elements pre-grouped by window and produces output after seeing all input.

SingleWindowFlinkCombineRunner() - Constructor for class org.apache.beam.runners.flink.translation.functions.SingleWindowFlinkCombineRunner

snapshotConfiguration() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

snapshotConfiguration() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueSerializer

snapshotStart(long) - Method in class org.apache.beam.runners.flink.translation.utils.CheckpointStats

snapshotState(FunctionSnapshotContext) - Method in class org.apache.beam.runners.flink.translation.functions.ImpulseSourceFunction

snapshotState(StateSnapshotContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

snapshotState(FunctionSnapshotContext) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

SortingFlinkCombineRunner<K,InputT,AccumT,OutputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.flink.translation.functions

A Flink combine runner that first sorts the elements by window and then does one pass that merges windows and outputs results.

SortingFlinkCombineRunner() - Constructor for class org.apache.beam.runners.flink.translation.functions.SortingFlinkCombineRunner

SourceInputFormat<T> - Class in org.apache.beam.runners.flink.translation.wrappers

Wrapper for executing a Source as a Flink InputFormat.

SourceInputFormat(String, BoundedSource<T>, PipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat

SourceInputSplit<T> - Class in org.apache.beam.runners.flink.translation.wrappers

InputSplit for SourceInputFormat.

SourceInputSplit() - Constructor for class org.apache.beam.runners.flink.translation.wrappers.SourceInputSplit

SourceInputSplit(Source<T>, int) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.SourceInputSplit

SplittableDoFnOperator<InputT,OutputT,RestrictionT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Flink operator for executing splittable DoFns.

SplittableDoFnOperator(DoFn<KeyedWorkItem<byte[], KV<InputT, RestrictionT>>, OutputT>, String, Coder<WindowedValue<KeyedWorkItem<byte[], KV<InputT, RestrictionT>>>>, Map<TupleTag<?>, Coder<?>>, TupleTag<OutputT>, List<TupleTag<?>>, DoFnOperator.OutputManagerFactory<OutputT>, WindowingStrategy<?, ?>, Map<Integer, PCollectionView<?>>, Collection<PCollectionView<?>>, PipelineOptions, Coder<?>, KeySelector<WindowedValue<KeyedWorkItem<byte[], KV<InputT, RestrictionT>>>, ?>) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.SplittableDoFnOperator

startBundle() - Method in class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate

startBundle() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.stableinput.BufferingDoFnRunner

state(StateNamespace, StateTag<T>, StateContext<?>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkBroadcastStateInternals

state(StateNamespace, StateTag<T>, StateContext<?>) - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.state.FlinkStateInternals

stateInternals() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkNoOpStepContext

stateInternals() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.FlinkStepContext

stepName - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

stop() - Method in interface org.apache.beam.runners.flink.translation.wrappers.streaming.io.BeamStoppableFunction

Unused method for backward compatibility.

stop() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

StreamingImpulseSource - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.io

Deprecated.

Legacy non-portable source which can be replaced by a DoFn with timers. https://jira.apache.org/jira/browse/BEAM-8353

StreamingImpulseSource(int, int) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.io.StreamingImpulseSource

Deprecated.

supportsNormalizedKey() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

supportsSerializationWithKeyNormalization() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

T

test(RunnerApi.PTransform) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.IsFlinkNativeTransform

test(RunnerApi.PTransform) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.IsFlinkNativeTransform

TestFlinkRunner - Class in org.apache.beam.runners.flink

Test Flink runner.

TestStreamSource<T> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.io

Flink source for executing TestStream.

TestStreamSource(SerializableFunction<byte[], TestStream<T>>, byte[]) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.io.TestStreamSource

timerInternals() - Method in class org.apache.beam.runners.flink.translation.functions.FlinkNoOpStepContext

timerInternals() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.FlinkStepContext

timerInternals - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

timerService - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

timersIterable() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItem

toString() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

toString() - Method in class org.apache.beam.runners.flink.FlinkRunner

toString() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

toString(Metric) - Static method in class org.apache.beam.runners.flink.metrics.Metrics

toString() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

toString() - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeSerializer

toString() - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueTypeInformation

translate(FlinkBatchPortablePipelineTranslator.BatchTranslationContext, RunnerApi.Pipeline) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator

translate(T, RunnerApi.Pipeline) - Method in interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

Translates the given pipeline.

translate(FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext, RunnerApi.Pipeline) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator

U

UnboundedSourceWrapper<OutputT,CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming.io

Wrapper for executing UnboundedSources as a Flink Source.

UnboundedSourceWrapper(String, PipelineOptions, UnboundedSource<OutputT, CheckpointMarkT>, int) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper

updateMetrics(String, List<MetricsApi.MonitoringInfo>) - Method in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer

Update this container with metrics from the passed MetricsApi.MonitoringInfos, and send updates along to Flink's internal metrics framework.

V

value() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItem

verifyDeterministic() - Method in class org.apache.beam.runners.flink.translation.wrappers.streaming.SingletonKeyedWorkItemCoder

visitPrimitiveTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.flink.translation.utils.CountingPipelineVisitor

visitPrimitiveTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.flink.translation.utils.LookupPipelineVisitor

W

waitUntilFinish() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

waitUntilFinish(Duration) - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult

waitUntilFinish() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

waitUntilFinish(Duration) - Method in class org.apache.beam.runners.flink.FlinkRunnerResult

WindowDoFnOperator<K,InputT,OutputT> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

Flink operator for executing window DoFns.

WindowDoFnOperator(SystemReduceFn<K, InputT, ?, OutputT, BoundedWindow>, String, Coder<WindowedValue<KeyedWorkItem<K, InputT>>>, TupleTag<KV<K, OutputT>>, List<TupleTag<?>>, DoFnOperator.OutputManagerFactory<KV<K, OutputT>>, WindowingStrategy<?, ?>, Map<Integer, PCollectionView<?>>, Collection<PCollectionView<?>>, PipelineOptions, Coder<K>, KeySelector<WindowedValue<KeyedWorkItem<K, InputT>>, ?>) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator

WindowedKvKeySelector<InputT,K> - Class in org.apache.beam.runners.flink.translation.types

KeySelector that extracts the key from a KV and returns it in encoded form as a byte array.

WindowedKvKeySelector(Coder<K>, Coder<? extends BoundedWindow>) - Constructor for class org.apache.beam.runners.flink.translation.types.WindowedKvKeySelector

windowingStrategy - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkPartialReduceFunction

windowingStrategy - Variable in class org.apache.beam.runners.flink.translation.functions.FlinkReduceFunction

windowingStrategy - Variable in class org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator

withPipelineOptions(PipelineOptions) - Method in class org.apache.beam.runners.flink.translation.types.CoderTypeInformation

Creates a new CoderTypeInformation with PipelineOptions, that can be used for FileSystems registration.

Workarounds - Class in org.apache.beam.runners.flink.translation.utils

Workarounds for dealing with limitations of Flink or its libraries.

Workarounds() - Constructor for class org.apache.beam.runners.flink.translation.utils.Workarounds

WorkItemKeySelector<K,V> - Class in org.apache.beam.runners.flink.translation.wrappers.streaming

KeySelector that retrieves a key from a KeyedWorkItem.

WorkItemKeySelector(Coder<K>, SerializablePipelineOptions) - Constructor for class org.apache.beam.runners.flink.translation.wrappers.streaming.WorkItemKeySelector

write(int) - Method in class org.apache.beam.runners.flink.translation.wrappers.DataOutputViewWrapper

write(byte[], int, int) - Method in class org.apache.beam.runners.flink.translation.wrappers.DataOutputViewWrapper

writeWithKeyNormalization(byte[], DataOutputView) - Method in class org.apache.beam.runners.flink.translation.types.EncodedValueComparator

A B C D E F G H I K L M N O P R S T U V W