Packages

t

org.apache.spark.sql.delta.commands

WriteIntoDeltaLike

trait WriteIntoDeltaLike extends AnyRef

An interface for writing data into Delta tables.

Linear Supertypes
AnyRef, Any
Known Subclasses
WriteIntoDelta
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. WriteIntoDeltaLike
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract val configuration: Map[String, String]

    The configuration to be used for writing data into Delta table.

  2. abstract val data: DataFrame

    Data to be written into Delta table.

  3. abstract val deltaLog: DeltaLog
  4. abstract def withNewWriterConfiguration(updatedConfiguration: Map[String, String]): WriteIntoDeltaLike

    A helper method to create a new instances of WriteIntoDeltaLike with updated configuration.

  5. abstract def writeAndReturnCommitData(txn: OptimisticTransaction, sparkSession: SparkSession, clusterBySpecOpt: Option[ClusterBySpec] = None, isTableReplace: Boolean = false): TaggedCommitData[Action]

    Write data into Delta table as part of txn and @return the actions to be committed.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def extractConstraints(sparkSession: SparkSession, expr: Seq[Expression]): Seq[Constraint]
    Attributes
    protected
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. def registerReplaceWhereMetrics(spark: SparkSession, txn: OptimisticTransaction, newFiles: Seq[Action], deleteActions: Seq[Action]): Unit

    Replace where operationMetrics need to be recorded separately.

    Replace where operationMetrics need to be recorded separately.

    newFiles

    - AddFile and AddCDCFile added by write job

    deleteActions

    - AddFile, RemoveFile, AddCDCFile added by Delete job

    Attributes
    protected
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  22. def write(txn: OptimisticTransaction, sparkSession: SparkSession, clusterBySpecOpt: Option[ClusterBySpec] = None, isTableReplace: Boolean = false): Seq[Action]

Inherited from AnyRef

Inherited from Any

Ungrouped