case class CheckpointInstance(version: Long, format: Format, fileName: Option[String] = None, numParts: Option[Int] = None) extends Ordered[CheckpointInstance] with Product with Serializable
A class to help with comparing checkpoints with each other, where we may have had concurrent
writers that checkpoint with different number of parts.
The numParts field will be present only for multipart checkpoints (represented by
Format.WITH_PARTS).
The fileName field is present only for V2 Checkpoints (represented by Format.V2)
These additional fields are used as a tie breaker when comparing multiple checkpoint
instance of same Format for the same version.
- Alphabetic
- By Inheritance
- CheckpointInstance
- Serializable
- Serializable
- Product
- Equals
- Ordered
- Comparable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
def
<(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
-
def
<=(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
>(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
-
def
>=(that: CheckpointInstance): Boolean
- Definition Classes
- Ordered
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
compare(other: CheckpointInstance): Int
Comparison rules: 1.
Comparison rules: 1. A CheckpointInstance with higher version is greater than the one with lower version. 2. For CheckpointInstances with same version, a Multi-part checkpoint is greater than a Single part checkpoint. 3. For Multi-part CheckpointInstances corresponding to same version, the one with more parts is greater than the one with less parts. 4. For V2 Checkpoints corresponding to same version, we use the fileName as tie breaker.
- Definition Classes
- CheckpointInstance → Ordered
-
def
compareTo(that: CheckpointInstance): Int
- Definition Classes
- Ordered → Comparable
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- val fileName: Option[String]
- def filterFiles(deltaLog: DeltaLog, filesForCheckpointConstruction: Seq[FileStatus]): Seq[FileStatus]
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
- val format: Format
-
def
getCheckpointProvider(deltaLog: DeltaLog, filesForCheckpointConstruction: Seq[FileStatus], lastCheckpointInfoHint: Option[LastCheckpointInfo] = None): UninitializedCheckpointProvider
Returns a CheckpointProvider which can tell the files corresponding to this checkpoint.
Returns a CheckpointProvider which can tell the files corresponding to this checkpoint. The
lastCheckpointInfoHintmight be passed to CheckpointProvider so that underlying CheckpointProvider provides more precise info. -
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val numParts: Option[Int]
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
- val version: Long
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()