Packages

c

io.delta.flink.source.internal.builder

ContinuousDeltaSourceBuilder

abstract class ContinuousDeltaSourceBuilder[T, SELF] extends DeltaSourceBuilderBase[T, SELF]

A base class for Delta source builders that should create Delta source instance for org.apache.flink.api.connector.source.Boundedness#CONTINUOUS_UNBOUNDED mode. This implementation contains methods from DeltaSourceBuilderBase base class and methods applicable only for Continuous mode.

Linear Supertypes
DeltaSourceBuilderBase[T, SELF], AnyRef, Any
Known Subclasses
RowDataContinuousDeltaSourceBuilder
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ContinuousDeltaSourceBuilder
  2. DeltaSourceBuilderBase
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ContinuousDeltaSourceBuilder(tablePath: Path, hadoopConfiguration: Configuration, snapshotSupplierFactory: ContinuousSnapshotSupplierFactory)

Abstract Value Members

  1. abstract def build[V <: DeltaSource[T]](): V
    Definition Classes
    DeltaSourceBuilderBase

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def columnNames(columnNames: List[String]): SELF

    Sets a List of column names that should be read from Delta table.

    Sets a List of column names that should be read from Delta table.

    Definition Classes
    DeltaSourceBuilderBase
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. def getApplicableOptions(): Collection[String]
    Attributes
    protected[builder]
    Definition Classes
    ContinuousDeltaSourceBuilder → DeltaSourceBuilderBase
    Annotations
    @Override()
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def getSourceConfiguration(): DeltaConnectorConfiguration

    returns

    A copy of DeltaConnectorConfiguration used by builder. The changes made on returned copy do not change the state of builder's configuration.

    Definition Classes
    DeltaSourceBuilderBase
  13. def getSourceSchema(): SourceSchema

    Extracts Delta table schema from DeltaLog io.delta.standalone.actions.Metadata including column names and column types converted to org.apache.flink.table.types.logical.LogicalType.

    Extracts Delta table schema from DeltaLog io.delta.standalone.actions.Metadata including column names and column types converted to org.apache.flink.table.types.logical.LogicalType.

    If #userColumnNames were defined, only those columns will be included in extracted schema.

    returns

    A SourceSchema including Delta table column names with their types that should be read from Delta table.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. def ignoreChanges(ignoreChanges: Boolean): SELF
  16. def ignoreDeletes(ignoreDeletes: Boolean): SELF
  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. def option(optionName: String, optionValue: Long): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  22. def option(optionName: String, optionValue: Int): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  23. def option(optionName: String, optionValue: Boolean): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  24. def option(optionName: String, optionValue: String): SELF

    Sets a configuration option.

    Sets a configuration option.

    Definition Classes
    DeltaSourceBuilderBase
  25. def prepareInapplicableOptionMessage(usedOptions: Collection[String], applicableOptions: Collection[String]): String
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  26. def prepareOptionExclusionMessage(mutualExclusiveOptions: <repeated...>[String]): String
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  27. def self(): SELF
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
    Annotations
    @SuppressWarnings()
  28. def startingTimestamp(startingTimestamp: String): SELF
  29. def startingVersion(startingVersion: Long): SELF
  30. def startingVersion(startingVersion: String): SELF
  31. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  32. def toString(): String
    Definition Classes
    AnyRef → Any
  33. def updateCheckIntervalMillis(updateCheckInterval: Long): SELF
  34. def validate(): Unit

    Validate definition of Delta source builder including mandatory and optional options.

    Validate definition of Delta source builder including mandatory and optional options.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  35. def validateInapplicableOptions(): Validator

    Validated builder options that were used but they might be not applicable for given builder type, for example using options from bounded mode like "versionAsOf" for continuous mode builder.

    Validated builder options that were used but they might be not applicable for given builder type, for example using options from bounded mode like "versionAsOf" for continuous mode builder.

    returns

    The Validator object with all (if any) validation error messages.

    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  36. def validateMandatoryOptions(): Validator
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  37. def validateOptionExclusions(): Validator

    This method should implement any logic for validation of mutually exclusive options.

    This method should implement any logic for validation of mutually exclusive options.

    returns

    Validator instance with validation error message.

    Attributes
    protected[builder]
    Definition Classes
    ContinuousDeltaSourceBuilder → DeltaSourceBuilderBase
    Annotations
    @Override()
  38. def validateOptionalParameters(): Validator
    Attributes
    protected[builder]
    Definition Classes
    DeltaSourceBuilderBase
  39. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  40. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  41. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from DeltaSourceBuilderBase[T, SELF]

Inherited from AnyRef

Inherited from Any

Ungrouped