abstract class LazyCompleteCheckpointProvider extends CheckpointProvider
A wrapper implementation of CheckpointProvider which wraps
underlyingCheckpointProviderFuture and uninitializedCheckpointProvider for implementing all
the UninitializedCheckpointProvider and CheckpointProvider APIs.
- Alphabetic
- By Inheritance
- LazyCompleteCheckpointProvider
- CheckpointProvider
- UninitializedCheckpointProvider
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new LazyCompleteCheckpointProvider(uninitializedCheckpointProvider: UninitializedCheckpointProvider)
- uninitializedCheckpointProvider
the underlying UninitializedCheckpointProvider
Abstract Value Members
- abstract def createCheckpointProvider(): CheckpointProvider
- Attributes
- protected
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def allActionsFileIndexes(): Seq[DeltaLogFileIndex]
List of different file indexes which could help derive full state-reconstruction for the checkpoint.
List of different file indexes which could help derive full state-reconstruction for the checkpoint.
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def checkpointPolicy: Option[Policy]
The type of checkpoint (V2 vs Classic).
The type of checkpoint (V2 vs Classic). This will be None when no checkpoint is available. This is only intended to be used for logging and metrics.
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- def effectiveCheckpointSizeInBytes(): Long
Effective size of checkpoint across all files
Effective size of checkpoint across all files
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def isEmpty: Boolean
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
- Definition Classes
- UninitializedCheckpointProvider
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- def topLevelFileIndex: Option[DeltaLogFileIndex]
File index which could help derive actions stored in top level files for the checkpoint.
File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
- def topLevelFiles: Seq[FileStatus]
Top level files that represents this checkpoint.
Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
- lazy val underlyingCheckpointProvider: CheckpointProvider
- def version: Long
Checkpoint version
Checkpoint version
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()