Type Members

1.  class BoundedDeltaSourceSplitEnumerator extends DeltaSourceSplitEnumerator

   A SplitEnumerator implementation for org.apache.flink.api.connector.source.Boundedness#BOUNDED mode.

   A SplitEnumerator implementation for org.apache.flink.api.connector.source.Boundedness#BOUNDED mode.

   This enumerator takes all files that are present in the configured Delta table directory, converts them to DeltaSourceSplit and assigns them to the readers. Once all files are processed, the source is finished.

   The actual logic for creating the set of DeltaSourceSplit to process, and the logic to decide which reader gets what split can be found DeltaSourceSplitEnumerator and in FileSplitAssigner, respectively.

2.  class BoundedSplitEnumeratorProvider extends SplitEnumeratorProvider

   An implementation of SplitEnumeratorProvider that creates a BoundedSplitEnumerator used for Boundedness#BOUNDED mode.

3.  class ContinuousDeltaSourceSplitEnumerator extends DeltaSourceSplitEnumerator

   A SplitEnumerator implementation for org.apache.flink.api.connector.source.Boundedness#CONTINUOUS_UNBOUNDED mode.

   A SplitEnumerator implementation for org.apache.flink.api.connector.source.Boundedness#CONTINUOUS_UNBOUNDED mode.

   This enumerator takes all files that are present in the configured Delta table directory, convert them to DeltaSourceSplit and assigns them to the readers. Once all files from initial snapshot are processed, it starts monitoring Delta table for changes. Each appending data change is converted to DeltaSourceSplit and assigned to readers.

   The actual logic for creating the set of DeltaSourceSplit to process, and the logic to decide which reader gets what split can be found DeltaSourceSplitEnumerator and in FileSplitAssigner, respectively.

4.  class ContinuousSplitEnumeratorProvider extends SplitEnumeratorProvider

   An implementation of SplitEnumeratorProvider that creates a ContinuousSplitEnumerator used for Boundedness#CONTINUOUS_UNBOUNDED mode.

5.  abstract class DeltaSourceSplitEnumerator extends SplitEnumerator[DeltaSourceSplit, DeltaEnumeratorStateCheckpoint[DeltaSourceSplit]]

   A base class for SplitEnumerator used by io.delta.flink.source.DeltaSource

   A base class for SplitEnumerator used by io.delta.flink.source.DeltaSource

   The implementations that will choose to extend this class will have to implement abstract method DeltaSourceSplitEnumerator#handleNoMoreSplits(int)

6.  trait SplitEnumeratorProvider extends Serializable

   Factory for SplitEnumerator.