Packages

c

org.apache.spark.sql.delta

VersionChecksum

case class VersionChecksum(txnId: Option[String], tableSizeBytes: Long, numFiles: Long, numDeletedRecordsOpt: Option[Long], numDeletionVectorsOpt: Option[Long], numMetadata: Long, numProtocol: Long, inCommitTimestampOpt: Option[Long], setTransactions: Option[Seq[SetTransaction]], domainMetadata: Option[Seq[DomainMetadata]], metadata: Metadata, protocol: Protocol, histogramOpt: Option[FileSizeHistogram], deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram], allFiles: Option[Seq[AddFile]]) extends Product with Serializable

Stats calculated within a snapshot, which we store along individual transactions for verification.

txnId

Optional transaction identifier

tableSizeBytes

The size of the table in bytes

numFiles

Number of AddFile actions in the snapshot

numDeletedRecordsOpt

The number of deleted records with Deletion Vectors.

numDeletionVectorsOpt

The number of Deletion Vectors present in the snapshot.

numMetadata

Number of Metadata actions in the snapshot

numProtocol

Number of Protocol actions in the snapshot

histogramOpt

Optional file size histogram

deletedRecordCountsHistogramOpt

A histogram of the deleted records count distribution for all the files in the snapshot.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. VersionChecksum
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new VersionChecksum(txnId: Option[String], tableSizeBytes: Long, numFiles: Long, numDeletedRecordsOpt: Option[Long], numDeletionVectorsOpt: Option[Long], numMetadata: Long, numProtocol: Long, inCommitTimestampOpt: Option[Long], setTransactions: Option[Seq[SetTransaction]], domainMetadata: Option[Seq[DomainMetadata]], metadata: Metadata, protocol: Protocol, histogramOpt: Option[FileSizeHistogram], deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram], allFiles: Option[Seq[AddFile]])

    txnId

    Optional transaction identifier

    tableSizeBytes

    The size of the table in bytes

    numFiles

    Number of AddFile actions in the snapshot

    numDeletedRecordsOpt

    The number of deleted records with Deletion Vectors.

    numDeletionVectorsOpt

    The number of Deletion Vectors present in the snapshot.

    numMetadata

    Number of Metadata actions in the snapshot

    numProtocol

    Number of Protocol actions in the snapshot

    histogramOpt

    Optional file size histogram

    deletedRecordCountsHistogramOpt

    A histogram of the deleted records count distribution for all the files in the snapshot.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val allFiles: Option[Seq[AddFile]]
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. val deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram]
  8. val domainMetadata: Option[Seq[DomainMetadata]]
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. val histogramOpt: Option[FileSizeHistogram]
  13. val inCommitTimestampOpt: Option[Long]
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. val metadata: Metadata
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. val numDeletedRecordsOpt: Option[Long]
  20. val numDeletionVectorsOpt: Option[Long]
  21. val numFiles: Long
  22. val numMetadata: Long
  23. val numProtocol: Long
  24. val protocol: Protocol
  25. val setTransactions: Option[Seq[SetTransaction]]
  26. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  27. val tableSizeBytes: Long
  28. val txnId: Option[String]
  29. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped