Type Members

1.  sealed abstract final class DeltaDataType extends Enum[DeltaDataType]

   An Enum representing Delta's DataType class types.

   An Enum representing Delta's DataType class types.

   This Enum can be used for example to build switch statement based on Delta's DataType type.

2.  class DeltaPartitionFieldExtractor[SplitT <: DeltaSourceSplit] extends PartitionFieldExtractor[SplitT]

   An implementation of Flink's PartitionFieldExtractor interface for Delta Lake tables.

   An implementation of Flink's PartitionFieldExtractor interface for Delta Lake tables. This implementation extracts partition values from DeltaSourceSplit#getPartitionValues(). The value is converted to proper LogicalType provided via column type array in Delta Source definition.

3.  class DeltaSourceInternal[T] extends Source[T, DeltaSourceSplit, DeltaEnumeratorStateCheckpoint[DeltaSourceSplit]] with ResultTypeQueryable[T]

   This is an internal class to hide Source API from the end user.

   This is an internal class to hide Source API from the end user.

   A unified data source that reads Delta table - both in batch and in streaming mode.

   This source supports all (distributed) file systems and object stores that can be accessed via the Flink's FileSystem class.

4.  class DeltaSourceOptions extends AnyRef

   This class contains all available options for io.delta.flink.source.DeltaSource with their type and default values.

   This class contains all available options for io.delta.flink.source.DeltaSource with their type and default values. It may be viewed as a kind of dictionary class. This class will be used both by Streaming and Table source.

5.  class SchemaConverter extends AnyRef

   A utility class to convert Delta's DataType objects to Flink's LogicalType equivalent object.