case class UninitializedV1OrV2ParquetCheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, lastCheckpointInfoOpt: Option[LastCheckpointInfo]) extends UninitializedV2LikeCheckpointProvider with Product with Serializable
An implementation of UninitializedCheckpointProvider to represent a parquet checkpoint which could be either a v1 checkpoint or v2 checkpoint. This needs to be resolved into a PreloadedCheckpointProvider or a V2CheckpointProvider depending on whether the CheckpointMetadata action is present or not in the underlying parquet file.
- Alphabetic
- By Inheritance
- UninitializedV1OrV2ParquetCheckpointProvider
- Serializable
- Product
- Equals
- UninitializedV2LikeCheckpointProvider
- UninitializedCheckpointProvider
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new UninitializedV1OrV2ParquetCheckpointProvider(version: Long, fileStatus: FileStatus, logPath: Path, lastCheckpointInfoOpt: Option[LastCheckpointInfo])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- val fileStatus: FileStatus
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def isEmpty: Boolean
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
True if the checkpoint provider is empty (does not refer to a valid checkpoint)
- Definition Classes
- UninitializedCheckpointProvider
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- val lastCheckpointInfoOpt: Option[LastCheckpointInfo]
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
- val logPath: Path
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def productElementNames: Iterator[String]
- Definition Classes
- Product
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- lazy val topLevelFileIndex: Option[DeltaLogFileIndex]
File index which could help derive actions stored in top level files for the checkpoint.
File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
- lazy val topLevelFiles: Seq[FileStatus]
Top level files that represents this checkpoint.
Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.
- Definition Classes
- UninitializedV2LikeCheckpointProvider → UninitializedCheckpointProvider
- val v2CheckpointFormat: Format
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedV2LikeCheckpointProvider
- val version: Long
Checkpoint version
Checkpoint version
- Definition Classes
- UninitializedV1OrV2ParquetCheckpointProvider → UninitializedCheckpointProvider
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()