org.apache.beam.sdk.io.gcp.bigtable.changestreams.action

Class GenerateInitialPartitionsAction

java.lang.Object

org.apache.beam.sdk.io.gcp.bigtable.changestreams.action.GenerateInitialPartitionsAction

@Internal
public class GenerateInitialPartitionsAction
extends java.lang.Object

Class to generate first set of outputs for DetectNewPartitionsDoFn.

Constructor Summary

Constructors

Constructor and Description
GenerateInitialPartitionsAction(ChangeStreamMetrics metrics, ChangeStreamDao changeStreamDao)

Method Summary

Modifier and Type

Method and Description

org.apache.beam.sdk.transforms.DoFn.ProcessContinuation

run(org.apache.beam.sdk.transforms.DoFn.OutputReceiver<PartitionRecord> receiver, org.apache.beam.sdk.transforms.splittabledofn.RestrictionTracker<org.apache.beam.sdk.io.range.OffsetRange,java.lang.Long> tracker, org.apache.beam.sdk.transforms.splittabledofn.ManualWatermarkEstimator<org.joda.time.Instant> watermarkEstimator, org.joda.time.Instant startTime) The very first step of the pipeline when there are no partitions being streamed yet.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenerateInitialPartitionsAction

public GenerateInitialPartitionsAction(ChangeStreamMetrics metrics,
                                       ChangeStreamDao changeStreamDao)

Method Detail

run

public org.apache.beam.sdk.transforms.DoFn.ProcessContinuation run(org.apache.beam.sdk.transforms.DoFn.OutputReceiver<PartitionRecord> receiver,
                                                                   org.apache.beam.sdk.transforms.splittabledofn.RestrictionTracker<org.apache.beam.sdk.io.range.OffsetRange,java.lang.Long> tracker,
                                                                   org.apache.beam.sdk.transforms.splittabledofn.ManualWatermarkEstimator<org.joda.time.Instant> watermarkEstimator,
                                                                   org.joda.time.Instant startTime)

The very first step of the pipeline when there are no partitions being streamed yet. We want to get an initial list of partitions to stream and output them.

Returns:

DoFn.ProcessContinuation.resume() if the stream continues, otherwise DoFn.ProcessContinuation.stop()