Packages

case class Optimize(predicate: Seq[Expression], zOrderBy: Seq[String] = Seq.empty, auto: Boolean = false, clusterBy: Option[Seq[String]] = None, isFull: Boolean = false) extends OptimizeOrReorg with Product with Serializable

Recorded when optimizing the table.

Linear Supertypes
Serializable, Serializable, Product, Equals, OptimizeOrReorg, OperationWithPredicates, Operation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Optimize
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. OptimizeOrReorg
  7. OperationWithPredicates
  8. Operation
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Optimize(predicate: Seq[Expression], zOrderBy: Seq[String] = Seq.empty, auto: Boolean = false, clusterBy: Option[Seq[String]] = None, isFull: Boolean = false)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. val auto: Boolean
  6. def changesData: Boolean

    Whether this operation changes data

    Whether this operation changes data

    Definition Classes
    Operation
  7. def checkAddFileWithDeletionVectorStatsAreNotTightBounds: Boolean

    A transaction that commits AddFile actions with deletionVector should have column stats that are not tight bounds.

    A transaction that commits AddFile actions with deletionVector should have column stats that are not tight bounds. An exception to this is ComputeStats operation, which recomputes stats on these files, and the new stats are tight bounds. Some other operations that merely take an existing AddFile action and commit a copy of it, not changing the deletionVector or stats, can then also recommit AddFile with deletionVector and tight bound stats that were recomputed before.

    An operation for which this can happen, and there is no way that it could be committing new deletion vectors, should set this to false to bypass this check. All other operations should set this to true, so that this is validated during commit.

    This is abstract to force the implementers of all operations to think about this setting. All operations should add a comment justifying this setting. Any operation that sets this to false should add a test in TightBoundsSuite.

    Definition Classes
    OptimizeOperation
  8. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  9. val clusterBy: Option[Seq[String]]
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. val isFull: Boolean
  14. val isInPlaceFileMetadataUpdate: Option[Boolean]

    Whether the transaction is updating metadata of existing files.

    Whether the transaction is updating metadata of existing files.

    The Delta protocol allows committing AddFile actions for files that already exist on the latest version of the table, without committing corresponding RemoveFile actions. This is used to update the metadata of existing files, e.g. to recompute statistics or add tags.

    Such operations need special handling during conflict checking, especially against no-data-change transactions, because the read/delete conflict can be resolved with read-file-remapping and because there is no RemoveFile action to trigger a delete/delete conflict. In case you are adding such operation, make sure to include a test for conflicts with business *and* no-data-change transactions, e.g. optimize.

    Definition Classes
    OptimizeOperation
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. lazy val jsonEncodedValues: Map[String, String]
    Definition Classes
    Operation
  17. val name: String
    Definition Classes
    OptimizeOrReorgOperation
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. val operationMetrics: Set[String]
    Definition Classes
    OptimizeOperation
  22. val parameters: Map[String, Any]
    Definition Classes
    OptimizeOperationWithPredicatesOperation
  23. val predicate: Seq[Expression]
  24. val predicates: Seq[Expression]
    Definition Classes
    OperationWithPredicates
  25. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  26. def transformDeletionVectorMetrics(allMetrics: Map[String, SQLMetric], dvMetrics: Map[String, MetricsTransformer] = ...): Map[String, String]

    Manually transform the deletion vector metrics, because they are not part of operationMetrics and are filtered out by the super.transformMetrics() call.

    Manually transform the deletion vector metrics, because they are not part of operationMetrics and are filtered out by the super.transformMetrics() call.

    Definition Classes
    Operation
  27. def transformMetrics(metrics: Map[String, SQLMetric]): Map[String, String]
    Definition Classes
    Operation
  28. val userMetadata: Option[String]
    Definition Classes
    Operation
  29. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  32. val zOrderBy: Seq[String]

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from OptimizeOrReorg

Inherited from OperationWithPredicates

Inherited from Operation

Inherited from AnyRef

Inherited from Any

Ungrouped