case class UninitializedV1OrV2ParquetCheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, lastCheckpointInfoOpt: Option[LastCheckpointInfo]) extends UninitializedV2LikeCheckpointProvider with Product with Serializable
An implementation of UninitializedCheckpointProvider to represent a parquet checkpoint which could be either a v1 checkpoint or v2 checkpoint. This needs to be resolved into a PreloadedCheckpointProvider or a V2CheckpointProvider depending on whether the CheckpointMetadata action is present or not in the underlying parquet file.
- Alphabetic
- By Inheritance
- UninitializedV1OrV2ParquetCheckpointProvider
- Serializable
- Serializable
- Product
- Equals
- UninitializedV2LikeCheckpointProvider
- UninitializedCheckpointProvider
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new UninitializedV1OrV2ParquetCheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, lastCheckpointInfoOpt: Option[LastCheckpointInfo])
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
val
fileStatus: FileStatus
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isEmpty: Boolean
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
- Definition Classes
- UninitializedCheckpointProvider
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
val
lastCheckpointInfoOpt: Option[LastCheckpointInfo]
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
-
val
logPath: Path
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
lazy val
topLevelFileIndex: Option[DeltaLogFileIndex]
File index which could help derive actions stored in top level files for the checkpoint.
File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
-
lazy val
topLevelFiles: Seq[FileStatus]
Top level files that represents this checkpoint.
Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
-
val
v2CheckpointFormat: Format
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
-
val
version: Long
Checkpoint version
Checkpoint version
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedCheckpointProvider
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()