case class UninitializedV2CheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, hadoopConf: Configuration, deltaLogOptions: Map[String, String], logStore: LogStore, lastCheckpointInfoOpt: Option[LastCheckpointInfo]) extends UninitializedV2LikeCheckpointProvider with Product with Serializable
An implementation of UninitializedCheckpointProvider to for v2 checkpoints. This needs to be resolved into a V2CheckpointProvider. This class starts an I/O to fetch the V2 actions (CheckpointMetadata, SidecarFile) as soon as the class is initialized so that the extra overhead could be parallelized with other operations like reading CRC.
- Alphabetic
- By Inheritance
- UninitializedV2CheckpointProvider
- Serializable
- Serializable
- Product
- Equals
- UninitializedV2LikeCheckpointProvider
- UninitializedCheckpointProvider
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new UninitializedV2CheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, hadoopConf: Configuration, deltaLogOptions: Map[String, String], logStore: LogStore, lastCheckpointInfoOpt: Option[LastCheckpointInfo])
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- val deltaLogOptions: Map[String, String]
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
val
fileStatus: FileStatus
- Definition Classes
- UninitializedV2CheckpointProvider → UninitializedV2LikeCheckpointProvider
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- val hadoopConf: Configuration
-
def
isEmpty: Boolean
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
- Definition Classes
- UninitializedCheckpointProvider
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
val
lastCheckpointInfoOpt: Option[LastCheckpointInfo]
- Definition Classes
- UninitializedV2CheckpointProvider → UninitializedV2LikeCheckpointProvider
-
val
logPath: Path
- Definition Classes
- UninitializedV2CheckpointProvider → UninitializedV2LikeCheckpointProvider
- val logStore: LogStore
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- val nonFateSharingCheckpointReadFuture: NonFateSharingFuture[(Option[CheckpointMetadata], Seq[SidecarFile])]
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
lazy val
topLevelFileIndex: Option[DeltaLogFileIndex]
File index which could help derive actions stored in top level files for the checkpoint.
File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
-
lazy val
topLevelFiles: Seq[FileStatus]
Top level files that represents this checkpoint.
Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
-
val
v2CheckpointFormat: Format
- Definition Classes
- UninitializedV2CheckpointProvider → UninitializedV2LikeCheckpointProvider
-
val
version: Long
Checkpoint version
Checkpoint version
- Definition Classes
- UninitializedV2CheckpointProvider → UninitializedCheckpointProvider
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()