Packages

p

io.delta

dynamodbcommitcoordinator

package dynamodbcommitcoordinator

Type Members

  1. class DynamoDBCommitCoordinatorClient extends CommitCoordinatorClient

    A commit coordinator client that uses DynamoDB as the commit coordinator.

    A commit coordinator client that uses DynamoDB as the commit coordinator. The table schema is as follows: tableId: String --- The unique identifier for the table. This is a UUID. path: String --- The fully qualified path of the table in the file system. e.g. s3://bucket/path. acceptingCommits: Boolean --- Whether the commit coordinator is accepting new commits. This will only be set to false when the table is converted from coordinated commits to file system commits. tableVersion: Number --- The version of the latest commit. tableTimestamp: Number --- The inCommitTimestamp of the latest commit. schemaVersion: Number --- The version of the schema used to store the data. hasAcceptedCommits: Boolean --- Whether any actual commits have been accepted by this commit coordinator after registerTable. commits: --- The list of unbackfilled commits. version: Number --- The version of the commit. inCommitTimestamp: Number --- The inCommitTimestamp of the commit. fsName: String --- The name of the unbackfilled file. fsLength: Number --- The length of the unbackfilled file. fsTimestamp: Number --- The modification time of the unbackfilled file.

  2. class DynamoDBCommitCoordinatorClientBuilder extends CommitCoordinatorBuilder
  3. class ReflectionUtils extends AnyRef

    Utility class for reflection operations.

    Utility class for reflection operations. Used to create AWS credentials provider from class name. Same as the io.delta.storage.utils.ReflectionUtils class is used in delta/storage-s3-dynamodb.

Ungrouped