case class CheckpointInstance(version: Long, format: Format, fileName: Option[String] = None, numParts: Option[Int] = None) extends Ordered[CheckpointInstance] with Product with Serializable
A class to help with comparing checkpoints with each other, where we may have had concurrent
writers that checkpoint with different number of parts.
The numParts field will be present only for multipart checkpoints (represented by
Format.WITH_PARTS).
The fileName field is present only for V2 Checkpoints (represented by Format.V2)
These additional fields are used as a tie breaker when comparing multiple checkpoint
instance of same Format for the same version.
- Alphabetic
- By Inheritance
- CheckpointInstance
- Serializable
- Product
- Equals
- Ordered
- Comparable
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- def <(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
- def <=(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def >(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
- def >=(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- def compare(other: CheckpointInstance): Int
Comparison rules: 1.
Comparison rules: 1. A CheckpointInstance with higher version is greater than the one with lower version. 2. For CheckpointInstances with same version, a Multi-part checkpoint is greater than a Single part checkpoint. 3. For Multi-part CheckpointInstances corresponding to same version, the one with more parts is greater than the one with less parts. 4. For V2 Checkpoints corresponding to same version, we use the fileName as tie breaker.
- Definition Classes
- CheckpointInstance → Ordered
- def compareTo(that: CheckpointInstance): Int
- Definition Classes
- Ordered → Comparable
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- val fileName: Option[String]
- def filterFiles(deltaLog: DeltaLog, filesForCheckpointConstruction: Seq[FileStatus]): Seq[FileStatus]
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- val format: Format
- def getCheckpointProvider(deltaLog: DeltaLog, filesForCheckpointConstruction: Seq[FileStatus], lastCheckpointInfoHint: Option[LastCheckpointInfo] = None): UninitializedCheckpointProvider
Returns a CheckpointProvider which can tell the files corresponding to this checkpoint.
Returns a CheckpointProvider which can tell the files corresponding to this checkpoint. The
lastCheckpointInfoHintmight be passed to CheckpointProvider so that underlying CheckpointProvider provides more precise info. - final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val numParts: Option[Int]
- def productElementNames: Iterator[String]
- Definition Classes
- Product
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- val version: Long
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()