Packages

c

io.delta.flink.sink

RowDataDeltaSinkBuilder

class RowDataDeltaSinkBuilder extends AnyRef

A builder class for DeltaSink for a stream of RowData.

For most common use cases use DeltaSink#forRowData utility method to instantiate the sink. After instantiation of this builder you can either call RowDataDeltaSinkBuilder#build() method to get the instance of a DeltaSink or configure additional behaviour (like merging of the schema or setting partition columns) and then build the sink.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RowDataDeltaSinkBuilder
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RowDataDeltaSinkBuilder(tableBasePath: Path, conf: Configuration, rowType: RowType, mergeSchema: Boolean)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def build(): DeltaSink[RowData]

    Creates the actual sink.

    Creates the actual sink.

    returns

    constructed DeltaSink object

  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. def option(optionName: String, optionValue: Long): RowDataDeltaSinkBuilder

    Sets a configuration option.

  17. def option(optionName: String, optionValue: Int): RowDataDeltaSinkBuilder

    Sets a configuration option.

  18. def option(optionName: String, optionValue: Boolean): RowDataDeltaSinkBuilder

    Sets a configuration option.

  19. def option(optionName: String, optionValue: String): RowDataDeltaSinkBuilder

    Sets a configuration option.

  20. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  25. def withMergeSchema(mergeSchema: Boolean): RowDataDeltaSinkBuilder

    Sets the sink's option whether we should try to update the Delta table's schema with the stream's schema in case of a mismatch during a commit to the io.delta.standalone.DeltaLog.

    Sets the sink's option whether we should try to update the Delta table's schema with the stream's schema in case of a mismatch during a commit to the io.delta.standalone.DeltaLog. The update is not guaranteed since it checks for compatible schemas.

    mergeSchema

    whether we should try to update the Delta table's schema with the stream's schema in case of a mismatch. This is not guaranteed since it requires compatible schemas.

    returns

    builder for DeltaSink

  26. def withPartitionColumns(partitionColumns: <repeated...>[String]): RowDataDeltaSinkBuilder

    Sets list of partition fields that will be extracted from incoming RowData events.

    Sets list of partition fields that will be extracted from incoming RowData events.

    Provided fields' names must correspond to the names provided in the RowType object for this sink and must be in the same order as expected order of occurrence in the partition path that will be generated.

    partitionColumns

    array of partition columns' names in the order they should be applied when creating destination path.

    returns

    builder for DeltaSink

Inherited from AnyRef

Inherited from Any

Ungrouped