| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.commit |
Support for committing the output of analytics jobs directly to S3.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| org.apache.hadoop.fs.s3a.select |
Support for S3 Select.
|
| org.apache.hadoop.fs.s3a.statistics |
Statistics collection for the S3A connector: interfaces.
|
| org.apache.hadoop.fs.s3a.statistics.impl |
Statistics collection for the S3A connector: implementation.
|
| org.apache.hadoop.fs.s3a.tools |
S3A Command line tools independent of S3Guard.
|
| Class and Description |
|---|
| BulkOperationState
This represents state which may be passed to bulk IO operations
to enable them to store information about the state of the ongoing
operation across invocations.
|
| BulkOperationState.OperationType
Enumeration of operations which can be performed in bulk.
|
DirListingMetadata
DirListingMetadata models a directory listing stored in a
MetadataStore. |
| ITtlTimeProvider
This interface is defined for handling TTL expiry of metadata in S3Guard.
|
MetadataStore
MetadataStore defines the set of operations that any metadata store
implementation must provide. |
| MetastoreInstrumentation
Instrumentation exported to S3Guard.
|
| Class and Description |
|---|
| BulkOperationState
This represents state which may be passed to bulk IO operations
to enable them to store information about the state of the ongoing
operation across invocations.
|
| Class and Description |
|---|
| BulkOperationState
This represents state which may be passed to bulk IO operations
to enable them to store information about the state of the ongoing
operation across invocations.
|
| ITtlTimeProvider
This interface is defined for handling TTL expiry of metadata in S3Guard.
|
MetadataStore
MetadataStore defines the set of operations that any metadata store
implementation must provide. |
| Class and Description |
|---|
| AbstractS3GuardDynamoDBDiagnostic
Entry point for S3Guard diagnostics operations against DynamoDB tables.
|
| BulkOperationState
This represents state which may be passed to bulk IO operations
to enable them to store information about the state of the ongoing
operation across invocations.
|
| BulkOperationState.OperationType
Enumeration of operations which can be performed in bulk.
|
DDBPathMetadata
DDBPathMetadata wraps PathMetadata and adds the
isAuthoritativeDir flag to provide support for authoritative directory
listings in DynamoDBMetadataStore. |
DirListingMetadata
DirListingMetadata models a directory listing stored in a
MetadataStore. |
| DumpS3GuardDynamoTable
This is a low-level diagnostics entry point which does a CVE/TSV dump of
the DDB state.
|
| DynamoDBClientFactory
Interface to create a DynamoDB client.
|
| DynamoDBMetadataStore
DynamoDBMetadataStore is a
MetadataStore that persists
file system metadata to DynamoDB. |
| DynamoDBMetadataStoreTableManager
Managing dynamo tables for S3Guard dynamodb based metadatastore.
|
| ExpirableMetadata
Expirable Metadata abstract class is for storing the field needed for
metadata classes in S3Guard that could be expired with TTL.
|
| ITtlTimeProvider
This interface is defined for handling TTL expiry of metadata in S3Guard.
|
MetadataStore
MetadataStore defines the set of operations that any metadata store
implementation must provide. |
| MetadataStore.PruneMode
Modes of operation for prune.
|
| MetastoreInstrumentation
Instrumentation exported to S3Guard.
|
PathMetadata
PathMetadata models path metadata stored in the
MetadataStore. |
| RenameTracker
A class which manages updating the metastore with the rename process
as initiated in the S3AFilesystem rename.
|
| S3Guard.DisabledWarnLevel
Warning levels to use when reporting S3Guard as disabled.
|
| S3GuardFsck.ComparePair
A compare pair with the pair of metadata and the list of violations.
|
| S3GuardFsck.Violation
Violation with severity and the handler.
|
| S3GuardFsckViolationHandler.HandleMode |
| S3GuardFsckViolationHandler.ViolationHandler
Violation handler abstract class.
|
| S3GuardTool
CLI to manage S3Guard Metadata Store.
|
| Class and Description |
|---|
| S3GuardTool
CLI to manage S3Guard Metadata Store.
|
| Class and Description |
|---|
| MetastoreInstrumentation
Instrumentation exported to S3Guard.
|
| Class and Description |
|---|
| MetastoreInstrumentation
Instrumentation exported to S3Guard.
|
| Class and Description |
|---|
| BulkOperationState
This represents state which may be passed to bulk IO operations
to enable them to store information about the state of the ongoing
operation across invocations.
|
| S3GuardTool
CLI to manage S3Guard Metadata Store.
|
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.