Packages

c

org.apache.spark.sql.delta

SnapshotState

case class SnapshotState(sizeInBytes: Long, numOfSetTransactions: Long, numOfFiles: Long, numOfRemoves: Long, numOfMetadata: Long, numOfProtocol: Long, setTransactions: Seq[SetTransaction], domainMetadata: Seq[DomainMetadata], metadata: Metadata, protocol: Protocol, fileSizeHistogram: Option[FileSizeHistogram] = None) extends Product with Serializable

Metrics and metadata computed around the Delta table.

sizeInBytes

The total size of the table (of active files, not including tombstones).

numOfSetTransactions

Number of streams writing to this table.

numOfFiles

The number of files in this table.

numOfRemoves

The number of tombstones in the state.

numOfMetadata

The number of metadata actions in the state. Should be 1.

numOfProtocol

The number of protocol actions in the state. Should be 1.

setTransactions

The streaming queries writing to this table.

metadata

The metadata of the table.

protocol

The protocol version of the Delta table.

fileSizeHistogram

A Histogram class tracking the file counts and total bytes in different size ranges.

Linear Supertypes
Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SnapshotState
  2. Serializable
  3. Product
  4. Equals
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new SnapshotState(sizeInBytes: Long, numOfSetTransactions: Long, numOfFiles: Long, numOfRemoves: Long, numOfMetadata: Long, numOfProtocol: Long, setTransactions: Seq[SetTransaction], domainMetadata: Seq[DomainMetadata], metadata: Metadata, protocol: Protocol, fileSizeHistogram: Option[FileSizeHistogram] = None)

    sizeInBytes

    The total size of the table (of active files, not including tombstones).

    numOfSetTransactions

    Number of streams writing to this table.

    numOfFiles

    The number of files in this table.

    numOfRemoves

    The number of tombstones in the state.

    numOfMetadata

    The number of metadata actions in the state. Should be 1.

    numOfProtocol

    The number of protocol actions in the state. Should be 1.

    setTransactions

    The streaming queries writing to this table.

    metadata

    The metadata of the table.

    protocol

    The protocol version of the Delta table.

    fileSizeHistogram

    A Histogram class tracking the file counts and total bytes in different size ranges.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. val domainMetadata: Seq[DomainMetadata]
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. val fileSizeHistogram: Option[FileSizeHistogram]
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. val metadata: Metadata
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. val numOfFiles: Long
  17. val numOfMetadata: Long
  18. val numOfProtocol: Long
  19. val numOfRemoves: Long
  20. val numOfSetTransactions: Long
  21. def productElementNames: Iterator[String]
    Definition Classes
    Product
  22. val protocol: Protocol
  23. val setTransactions: Seq[SetTransaction]
  24. val sizeInBytes: Long
  25. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  26. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  27. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  28. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped