package processor
Type Members
-
class
ActionProcessor extends AnyRef
This class process
Actionfrom Delta table version and produces a collection ofAddFileobject that were recorded for given version. - abstract class BaseTableProcessor extends TableProcessor
-
class
ChangesProcessor extends TableProcessorBase with ContinuousTableProcessor
This implementation of
TableProcessorprocess only Delta table changes starting from specifiedio.delta.standalone.Snapshotversion.This implementation of
TableProcessorprocess only Delta table changes starting from specifiedio.delta.standalone.Snapshotversion. This implementation does not readSnapshotcontent.The
Snapshotversion is specified byTableMonitorused when creating an instance ofChangesProcessor. -
trait
ContinuousTableProcessor extends TableProcessor
Extension of
TableProcessorfororg.apache.flink.api.connector.source.Boundedness#CONTINUOUS_UNBOUNDEDmode where Delta table changes should be also processed. -
class
SnapshotAndChangesTableProcessor extends ContinuousTableProcessor
This implementation of
TableProcessorprocess both, content ofio.delta.standalone.Snapshotand changes applied to monitored Delta table by converting them toDeltaSourceSplitobjects.This implementation of
TableProcessorprocess both, content ofio.delta.standalone.Snapshotand changes applied to monitored Delta table by converting them toDeltaSourceSplitobjects.This implementation uses both
SnapshotProcessorto readSnapshotcontent andChangesProcessorto read all changes applied after snapshot processed by encapsulatedSnapshotProcessor. -
class
SnapshotProcessor extends TableProcessorBase
This implementation of
TableProcessorprocess data from Delta tableSnapshot. -
trait
TableProcessor extends AnyRef
A processor for Delta table data.
A processor for Delta table data.
The implementations of this interface should encapsulate logic for processing Delta table Changes and Add Files.
- abstract class TableProcessorBase extends TableProcessor