Packages

package processor

Type Members

  1. class ActionProcessor extends AnyRef

    This class process Action from Delta table version and produces a collection of AddFile object that were recorded for given version.

  2. abstract class BaseTableProcessor extends TableProcessor
  3. class ChangesProcessor extends TableProcessorBase with ContinuousTableProcessor

    This implementation of TableProcessor process only Delta table changes starting from specified io.delta.standalone.Snapshot version.

    This implementation of TableProcessor process only Delta table changes starting from specified io.delta.standalone.Snapshot version. This implementation does not read Snapshot content.

    The Snapshot version is specified by TableMonitor used when creating an instance of ChangesProcessor.

  4. trait ContinuousTableProcessor extends TableProcessor

    Extension of TableProcessor for org.apache.flink.api.connector.source.Boundedness#CONTINUOUS_UNBOUNDED mode where Delta table changes should be also processed.

  5. class SnapshotAndChangesTableProcessor extends ContinuousTableProcessor

    This implementation of TableProcessor process both, content of io.delta.standalone.Snapshot and changes applied to monitored Delta table by converting them to DeltaSourceSplit objects.

    This implementation of TableProcessor process both, content of io.delta.standalone.Snapshot and changes applied to monitored Delta table by converting them to DeltaSourceSplit objects.

    This implementation uses both SnapshotProcessor to read Snapshot content and ChangesProcessor to read all changes applied after snapshot processed by encapsulated SnapshotProcessor.

  6. class SnapshotProcessor extends TableProcessorBase

    This implementation of TableProcessor process data from Delta table Snapshot.

  7. trait TableProcessor extends AnyRef

    A processor for Delta table data.

    A processor for Delta table data.

    The implementations of this interface should encapsulate logic for processing Delta table Changes and Add Files.

  8. abstract class TableProcessorBase extends TableProcessor

Ungrouped