Packages

o

org.apache.spark.sql.delta

DeltaOperations

object DeltaOperations

Exhaustive list of operations that can be performed on a Delta table. These operations are tracked as the first line in delta logs, and power DESCRIBE HISTORY for Delta tables.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DeltaOperations
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class AddColumns(colsToAdd: Seq[QualifiedColTypeWithPositionForLog]) extends Operation with Product with Serializable

    Recorded when columns are added.

  2. case class ChangeColumn(columnPath: Seq[String], columnName: String, newColumn: StructField, colPosition: Option[String]) extends Operation with Product with Serializable

    Recorded when columns are changed.

  3. case class ComputeStats(predicate: Seq[String]) extends Operation with Product with Serializable

    Recorded when recomputing stats on the table.

  4. case class Convert(numFiles: Long, partitionBy: Seq[String], collectStats: Boolean, catalogTable: Option[String]) extends Operation with Product with Serializable

    Recorded when converting a table into a Delta table.

  5. case class CreateTable(metadata: Metadata, isManaged: Boolean, asSelect: Boolean = false) extends Operation with Product with Serializable

    Recorded when the table is created.

  6. case class Delete(predicate: Seq[String]) extends Operation with Product with Serializable

    Recorded while deleting certain partitions.

  7. case class Fsck(numRemovedFiles: Long) extends Operation with Product with Serializable

    Recorded when fscking the table.

  8. case class Merge(predicate: Option[String], updatePredicate: Option[String], deletePredicate: Option[String], insertPredicate: Option[String]) extends Operation with Product with Serializable

    Recorded when a merge operation is committed to the table.

  9. sealed abstract class Operation extends AnyRef

    An operation that can be performed on a Delta table.

  10. case class Optimize(predicate: Seq[String], zOrderBy: Seq[String], batchId: Int, auto: Boolean) extends Operation with Product with Serializable

    Recorded when optimizing the table.

  11. case class QualifiedColTypeWithPositionForLog(columnPath: Seq[String], column: StructField, colPosition: Option[String]) extends Product with Serializable

    Qualified column type with position.

    Qualified column type with position. We define a copy of the type here to avoid depending on the parser output classes in our logging.

  12. case class ReplaceColumns(columns: Seq[StructField]) extends Operation with Product with Serializable

    Recorded when columns are replaced.

  13. case class ReplaceTable(metadata: Metadata, isManaged: Boolean, orCreate: Boolean, asSelect: Boolean = false) extends Operation with Product with Serializable

    Recorded when the table is replaced.

  14. case class ResetZCubeInfo(predicate: Seq[String], zOrderBy: Seq[String]) extends Operation with Product with Serializable

    Recorded when manually re-/un-/setting ZCube Information for existing files.

  15. case class SetTableProperties(properties: Map[String, String]) extends Operation with Product with Serializable

    Recorded when the table properties are set.

  16. case class StreamingUpdate(outputMode: OutputMode, queryId: String, epochId: Long) extends Operation with Product with Serializable

    Recorded during streaming inserts.

  17. case class Truncate() extends Operation with Product with Serializable

    Recorded when truncating the table.

  18. case class UnsetTableProperties(propKeys: Seq[String], ifExists: Boolean) extends Operation with Product with Serializable

    Recorded when the table properties are unset.

  19. case class Update(predicate: Option[String]) extends Operation with Product with Serializable

    Recorded when an update operation is committed to the table.

  20. case class UpdateColumnMetadata(operationName: String, columns: Seq[(Seq[String], StructField)]) extends Operation with Product with Serializable
  21. case class UpdateSchema(oldSchema: StructType, newSchema: StructType) extends Operation with Product with Serializable
  22. case class UpgradeProtocol(newProtocol: Protocol) extends Operation with Product with Serializable
  23. case class Write(mode: SaveMode, partitionBy: Option[Seq[String]] = None, predicate: Option[String] = None) extends Operation with Product with Serializable

    Recorded during batch inserts.

    Recorded during batch inserts. Predicates can be provided for overwrites.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  16. def toString(): String
    Definition Classes
    AnyRef → Any
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  20. object FileNotificationRetention extends Operation
  21. object ManualUpdate extends Operation

Inherited from AnyRef

Inherited from Any

Ungrouped