Packages

c

io.delta.flink.source.internal.builder

BoundedDeltaSourceBuilder

abstract class BoundedDeltaSourceBuilder[T, SELF] extends DeltaSourceBuilderBase[T, SELF]

A base class for Delta source builders that should create Delta source instance for org.apache.flink.api.connector.source.Boundedness#BOUNDED mode. This implementation contains methods from DeltaSourceBuilderBase base class and methods applicable only for Bounded mode.

Linear Supertypes
DeltaSourceBuilderBase[T, SELF], AnyRef, Any
Known Subclasses
RowDataBoundedDeltaSourceBuilder
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BoundedDeltaSourceBuilder
  2. DeltaSourceBuilderBase
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BoundedDeltaSourceBuilder(tablePath: Path, hadoopConfiguration: Configuration, snapshotSupplierFactory: BoundedSnapshotSupplierFactory)

Abstract Value Members

  1. abstract def build[V <: DeltaSource[T]](): V
    Definition Classes
    DeltaSourceBuilderBase

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def columnNames(columnNames: List[String]): SELF

    Sets a List of column names that should be read from Delta table.

    Sets a List of column names that should be read from Delta table.

    Definition Classes
    DeltaSourceBuilderBase
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. def getApplicableOptions(): Collection[String]
    Attributes
    protected[builder]
    Definition Classes
    BoundedDeltaSourceBuilder → DeltaSourceBuilderBase
    Annotations
    @Override()
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def getSourceConfiguration(): DeltaConnectorConfiguration

    returns

    A copy of DeltaConnectorConfiguration used by builder. The changes made on returned copy do not change the state of builder's configuration.

    Definition Classes
    DeltaSourceBuilderBase
  13. def getSourceSchema(): SourceSchema

    Extracts Delta table schema from DeltaLog io.delta.standalone.actions.Metadata including column names and column types converted to org.apache.flink.table.types.logical.LogicalType.

    Extracts Delta table schema from DeltaLog io.delta.standalone.actions.Metadata including column names and column types converted to org.apache.flink.table.types.logical.LogicalType.

    If #userColumnNames were defined, only those columns will be included in extracted schema.

    returns

    A SourceSchema including Delta table column names with their types that should be read from Delta table.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. def option(optionName: String, optionValue: Long): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  20. def option(optionName: String, optionValue: Int): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  21. def option(optionName: String, optionValue: Boolean): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  22. def option(optionName: String, optionValue: String): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  23. def prepareInapplicableOptionMessage(usedOptions: Collection[String], applicableOptions: Collection[String]): String
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  24. def prepareOptionExclusionMessage(mutualExclusiveOptions: <repeated...>[String]): String
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  25. def self(): SELF
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
    Annotations
    @SuppressWarnings()
  26. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  27. def timestampAsOf(snapshotTimestamp: String): SELF
  28. def toString(): String
    Definition Classes
    AnyRef → Any
  29. def validate(): Unit

    Validate definition of Delta source builder including mandatory and optional options.

    Validate definition of Delta source builder including mandatory and optional options.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  30. def validateInapplicableOptions(): Validator

    Validated builder options that were used but they might be not applicable for given builder type, for example using options from bounded mode like "versionAsOf" for continuous mode builder.

    Validated builder options that were used but they might be not applicable for given builder type, for example using options from bounded mode like "versionAsOf" for continuous mode builder.

    returns

    The Validator object with all (if any) validation error messages.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  31. def validateMandatoryOptions(): Validator
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  32. def validateOptionExclusions(): Validator

    This method should implement any logic for validation of mutually exclusive options.

    This method should implement any logic for validation of mutually exclusive options.

    returns

    Validator instance with validation error message.

    Attributes
    protected[builder]
    Definition Classes
    BoundedDeltaSourceBuilder → DeltaSourceBuilderBase
    Annotations
    @Override()
  33. def validateOptionalParameters(): Validator
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  34. def versionAsOf(snapshotVersion: Long): SELF
  35. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from DeltaSourceBuilderBase[T, SELF]

Inherited from AnyRef

Inherited from Any

Ungrouped