package coordinatedcommits
- Alphabetic
- Public
- All
Type Members
-
trait
AbstractBatchBackfillingCommitCoordinatorClient extends CommitCoordinatorClient with LoggingShims
An abstract CommitCoordinatorClient which triggers backfills every n commits.
An abstract CommitCoordinatorClient which triggers backfills every n commits. - every commit version which satisfies
commitVersion % batchSize == 0will trigger a backfill. -
trait
CommitCoordinatorBuilder extends AnyRef
A builder interface for CommitCoordinatorClient
- class InMemoryCommitCoordinator extends AbstractBatchBackfillingCommitCoordinatorClient
-
case class
InMemoryCommitCoordinatorBuilder(batchSize: Long) extends CommitCoordinatorBuilder with Product with Serializable
The InMemoryCommitCoordinatorBuilder class is responsible for creating singleton instances of InMemoryCommitCoordinator with the specified batchSize.
-
case class
TableCommitCoordinatorClient(commitCoordinatorClient: CommitCoordinatorClient, logPath: Path, tableConf: Map[String, String], hadoopConf: Configuration, logStore: LogStore) extends Product with Serializable
A wrapper around CommitCoordinatorClient that provides a more user-friendly API for committing/ accessing commits to a specific table.
A wrapper around CommitCoordinatorClient that provides a more user-friendly API for committing/ accessing commits to a specific table. This class takes care of passing the table specific configuration to the underlying CommitCoordinatorClient e.g. logPath / logStore / coordinatedCommitsTableConf / hadoopConf.
- commitCoordinatorClient
the underlying CommitCoordinatorClient
- logPath
the path to the log directory
- tableConf
the table specific coordinated-commits configuration
- hadoopConf
hadoop configuration
- logStore
the log store
Value Members
- object CommitCoordinatorClient
-
object
CommitCoordinatorProvider
Factory to get the correct CommitCoordinatorClient for a table
-
object
CoordinatedCommitsUsageLogs
Class containing usage logs emitted by Coordinated Commits.
- object CoordinatedCommitsUtils extends DeltaLogging
- object TableCommitCoordinatorClient extends Serializable