Packages

c

org.apache.spark.sql.delta

SnapshotState

case class SnapshotState(sizeInBytes: Long, numOfSetTransactions: Long, numOfFiles: Long, numOfRemoves: Long, numDeletedRecordsOpt: Option[Long], numDeletionVectorsOpt: Option[Long], numOfMetadata: Long, numOfProtocol: Long, setTransactions: Seq[SetTransaction], domainMetadata: Seq[DomainMetadata], metadata: Metadata, protocol: Protocol, fileSizeHistogram: Option[FileSizeHistogram] = None, deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram] = None) extends Product with Serializable

Metrics and metadata computed around the Delta table.

sizeInBytes

The total size of the table (of active files, not including tombstones).

numOfSetTransactions

Number of streams writing to this table.

numOfFiles

The number of files in this table.

numOfRemoves

The number of tombstones in the state.

numDeletedRecordsOpt

The total number of records deleted with Deletion Vectors.

numDeletionVectorsOpt

The number of Deletion Vectors present in the table.

numOfMetadata

The number of metadata actions in the state. Should be 1.

numOfProtocol

The number of protocol actions in the state. Should be 1.

setTransactions

The streaming queries writing to this table.

metadata

The metadata of the table.

protocol

The protocol version of the Delta table.

fileSizeHistogram

A Histogram class tracking the file counts and total bytes in different size ranges.

deletedRecordCountsHistogramOpt

A histogram of deletion records counts distribution for all files.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SnapshotState
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SnapshotState(sizeInBytes: Long, numOfSetTransactions: Long, numOfFiles: Long, numOfRemoves: Long, numDeletedRecordsOpt: Option[Long], numDeletionVectorsOpt: Option[Long], numOfMetadata: Long, numOfProtocol: Long, setTransactions: Seq[SetTransaction], domainMetadata: Seq[DomainMetadata], metadata: Metadata, protocol: Protocol, fileSizeHistogram: Option[FileSizeHistogram] = None, deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram] = None)

    sizeInBytes

    The total size of the table (of active files, not including tombstones).

    numOfSetTransactions

    Number of streams writing to this table.

    numOfFiles

    The number of files in this table.

    numOfRemoves

    The number of tombstones in the state.

    numDeletedRecordsOpt

    The total number of records deleted with Deletion Vectors.

    numDeletionVectorsOpt

    The number of Deletion Vectors present in the table.

    numOfMetadata

    The number of metadata actions in the state. Should be 1.

    numOfProtocol

    The number of protocol actions in the state. Should be 1.

    setTransactions

    The streaming queries writing to this table.

    metadata

    The metadata of the table.

    protocol

    The protocol version of the Delta table.

    fileSizeHistogram

    A Histogram class tracking the file counts and total bytes in different size ranges.

    deletedRecordCountsHistogramOpt

    A histogram of deletion records counts distribution for all files.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. val deletedRecordCountsHistogramOpt: Option[DeletedRecordCountsHistogram]
  7. val domainMetadata: Seq[DomainMetadata]
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. val fileSizeHistogram: Option[FileSizeHistogram]
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. val metadata: Metadata
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. val numDeletedRecordsOpt: Option[Long]
  18. val numDeletionVectorsOpt: Option[Long]
  19. val numOfFiles: Long
  20. val numOfMetadata: Long
  21. val numOfProtocol: Long
  22. val numOfRemoves: Long
  23. val numOfSetTransactions: Long
  24. val protocol: Protocol
  25. val setTransactions: Seq[SetTransaction]
  26. val sizeInBytes: Long
  27. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped