Packages

c

io.delta.standalone.internal

KernelSnapshotDelegator

class KernelSnapshotDelegator extends SnapshotImpl

This class is designed to be passed to OptimisticTransactionImpl, and provide exactly what that needs to operate, but on a Kernel Snapshot rather than a standalone Snapshot.

The methods/variables used by OptimisticTransactionImpl that we implement are:

  • protocolScala
  • metadataScala
  • version
  • getMetadata

Other functions that are used, we do not implement, but fall back to standalone. These functions are only called in "exceptional" cases, so should not overly impact performance. They include:

  • scanScala (only called in markFilesAsRead, not used by flink)
  • transactions (only used in txnVersion, which is used only on first commit for a flink app)
    • This is a val, but it calls setTransactionsScala, so we log for that
  • numOfFiles (only used in verifySchemaCompatibility, which happens only when a metadata update occures)
  • allFilesScala (only used in verifySchemaCompatibility)
Linear Supertypes
SnapshotImpl, Logging, Snapshot, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KernelSnapshotDelegator
  2. SnapshotImpl
  3. Logging
  4. Snapshot
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KernelSnapshotDelegator(kernelSnapshot: kernel.internal.SnapshotImpl, kernelSnapshotWrapper: KernelSnapshotWrapper, hadoopConf: Configuration, path: Path, version: Long, kernelDeltaLog: KernelDeltaLogDelegator, standaloneDeltaLog: DeltaLogImpl)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def allFilesScala: Seq[AddFile]
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. val deltaLog: DeltaLogImpl
    Definition Classes
    SnapshotImpl
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. def getAllFiles(): List[AddFile]
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def getLatestTransactionVersion(id: String): Option[Long]
  14. def getMetadata(): Metadata
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  15. def getVersion(): Long
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  16. val hadoopConf: Configuration
    Definition Classes
    SnapshotImpl
  17. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  18. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  19. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  20. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  21. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  22. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  23. val logSegment: LogSegment
    Definition Classes
    SnapshotImpl
  24. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  25. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  26. lazy val metadataScala: Metadata
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  27. val minFileRetentionTimestamp: Long
    Definition Classes
    SnapshotImpl
  28. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  29. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  30. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  31. def numOfFiles: Long
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  32. def open(): CloseableIterator[RowRecord]
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  33. val path: Path
    Definition Classes
    SnapshotImpl
  34. def protocol: Protocol
    Definition Classes
    SnapshotImpl
  35. lazy val protocolMetadataLoadMetrics: ProtocolMetadataLoadMetrics
    Definition Classes
    SnapshotImpl
  36. lazy val protocolScala: Protocol

    Internal vals we need to override

    Internal vals we need to override

    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  37. def scan(predicate: Expression): DeltaScan
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  38. def scan(): DeltaScan
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl → Snapshot
  39. def scanScala(): DeltaScanImpl
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  40. def scanScala(predicate: Expression): DeltaScanImpl
    Definition Classes
    SnapshotImpl
  41. def setTransactions: Seq[SetTransaction]
    Definition Classes
    SnapshotImpl
  42. def setTransactionsScala: Seq[SetTransaction]
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  43. lazy val standaloneSnapshot: SnapshotImpl
  44. lazy val state: State
    Attributes
    protected
    Definition Classes
    SnapshotImpl
  45. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  46. val timestamp: Long
    Definition Classes
    SnapshotImpl
  47. def toString(): String
    Definition Classes
    AnyRef → Any
  48. def tombstones: Seq[RemoveFile]
    Definition Classes
    SnapshotImpl
  49. def tombstonesScala: Seq[RemoveFile]
    Definition Classes
    SnapshotImpl
  50. lazy val transactions: Map[String, Long]
    Definition Classes
    SnapshotImpl
  51. val version: Long
    Definition Classes
    KernelSnapshotDelegator → SnapshotImpl
  52. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  54. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from SnapshotImpl

Inherited from Logging

Inherited from Snapshot

Inherited from AnyRef

Inherited from Any

Ungrouped