Packages

package schema

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class CheckDeltaInvariant(child: Expression, invariant: Invariant) extends UnaryExpression with NonSQLExpression with Product with Serializable

    An expression that validates a specific invariant on a column, before writing into Delta.

  2. case class DeltaInvariantCheckerExec(child: SparkPlan, invariants: Seq[Invariant]) extends SparkPlan with UnaryExecNode with Product with Serializable

    A physical operator that validates records, before they are written into Delta.

    A physical operator that validates records, before they are written into Delta. Each row is left unchanged after validations.

  3. trait ImplicitMetadataOperation extends DeltaLogging

    A trait that writers into Delta can extend to update the schema and/or partitioning of the table.

  4. case class Invariant(column: Seq[String], rule: Rule) extends Product with Serializable

    A rule applied on a column to ensure data hygiene.

  5. case class InvariantViolationException(msg: String) extends IllegalArgumentException with Product with Serializable

    Thrown when the given data doesn't match the rules defined on the table.

Value Members

  1. object InvariantViolationException extends Serializable
  2. object Invariants

    List of invariants that can be defined on a Delta table that will allow us to perform validation checks during changes to the table.

  3. object SchemaUtils

Ungrouped