Packages

o

org.apache.spark.sql.delta

EmptyCheckpointProvider

object EmptyCheckpointProvider extends CheckpointProvider

An implementation for CheckpointProvider which could be used to represent a scenario when checkpoint doesn't exist. This helps us simplify the code by making LogSegment.checkpointProvider as non-optional.

The CheckpointProvider.isEmpty method returns true for EmptyCheckpointProvider. Also version is returned as -1. For a real checkpoint, this will be returned true and version will be >= 0.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. EmptyCheckpointProvider
  2. CheckpointProvider
  3. UninitializedCheckpointProvider
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def allActionsFileIndexes(): Seq[DeltaLogFileIndex]

    List of different file indexes which could help derive full state-reconstruction for the checkpoint.

    List of different file indexes which could help derive full state-reconstruction for the checkpoint.

    Definition Classes
    EmptyCheckpointProviderCheckpointProvider
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def checkpointPolicy: Option[Policy]

    The type of checkpoint (V2 vs Classic).

    The type of checkpoint (V2 vs Classic). This will be None when no checkpoint is available. This is only intended to be used for logging and metrics.

    Definition Classes
    EmptyCheckpointProviderCheckpointProvider
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  8. def effectiveCheckpointSizeInBytes(): Long

    Effective size of checkpoint across all files

    Effective size of checkpoint across all files

    Definition Classes
    EmptyCheckpointProviderCheckpointProvider
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. def isEmpty: Boolean

    True if the checkpoint provider is empty (does not refer to a valid checkpoint)

    True if the checkpoint provider is empty (does not refer to a valid checkpoint)

    Definition Classes
    UninitializedCheckpointProvider
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  20. def toString(): String
    Definition Classes
    AnyRef → Any
  21. def topLevelFileIndex: Option[DeltaLogFileIndex]

    File index which could help derive actions stored in top level files for the checkpoint.

    File index which could help derive actions stored in top level files for the checkpoint. This could be used to get Protocol, Metadata etc from a checkpoint. This could also be used if we want to shallow copy a checkpoint.

    Definition Classes
    EmptyCheckpointProviderUninitializedCheckpointProvider
  22. def topLevelFiles: Seq[FileStatus]

    Top level files that represents this checkpoint.

    Top level files that represents this checkpoint. These files could be reused again to initialize the CheckpointProvider.

    Definition Classes
    EmptyCheckpointProviderUninitializedCheckpointProvider
  23. def version: Long

    Checkpoint version

    Checkpoint version

    Definition Classes
    EmptyCheckpointProviderUninitializedCheckpointProvider
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from CheckpointProvider

Inherited from AnyRef

Inherited from Any

Ungrouped