abstract class LazyCompleteCheckpointProvider extends CheckpointProvider
A wrapper implementation of CheckpointProvider which wraps
underlyingCheckpointProviderFuture and uninitializedCheckpointProvider for implementing all
the UninitializedCheckpointProvider and CheckpointProvider APIs.
- Alphabetic
- By Inheritance
- LazyCompleteCheckpointProvider
- CheckpointProvider
- UninitializedCheckpointProvider
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
LazyCompleteCheckpointProvider(uninitializedCheckpointProvider: UninitializedCheckpointProvider)
- uninitializedCheckpointProvider
the underlying UninitializedCheckpointProvider
Abstract Value Members
-
abstract
def
createCheckpointProvider(): CheckpointProvider
- Attributes
- protected
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
allActionsFileIndexes(): Seq[DeltaLogFileIndex]
List of different file indexes which could help derive full state-reconstruction for the checkpoint.
List of different file indexes which could help derive full state-reconstruction for the checkpoint.
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkpointPolicy: Option[Policy]
The type of checkpoint (V2 vs Classic).
The type of checkpoint (V2 vs Classic). This will be None when no checkpoint is available. This is only intended to be used for logging and metrics.
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
effectiveCheckpointSizeInBytes(): Long
Effective size of checkpoint across all files
Effective size of checkpoint across all files
- Definition Classes
- LazyCompleteCheckpointProvider → CheckpointProvider
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isEmpty: Boolean
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
- Definition Classes
- UninitializedCheckpointProvider
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
topLevelFileIndex: Option[DeltaLogFileIndex]
File index which could help derive actions stored in top level files for the checkpoint.
File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
-
def
topLevelFiles: Seq[FileStatus]
Top level files that represents this checkpoint.
Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
- lazy val underlyingCheckpointProvider: CheckpointProvider
-
def
version: Long
Checkpoint version
Checkpoint version
- Definition Classes
- LazyCompleteCheckpointProvider → UninitializedCheckpointProvider
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()