@InterfaceAudience.Private @InterfaceStability.Evolving

Package org.apache.hadoop.fs.s3a.s3guard

This package contains classes related to S3Guard: a feature of S3A to mask the eventual consistency behavior of S3 and optimize access patterns by coordinating with a strongly consistent external store for file system metadata.

See: Description

Interface Summary

Interface	Description
DynamoDBClientFactory	Interface to create a DynamoDB client.
MetadataStore	MetadataStore defines the set of operations that any metadata store implementation must provide.

Class Summary

Class	Description
DDBPathMetadata	DDBPathMetadata wraps PathMetadata and adds the isAuthoritativeDir flag to provide support for authoritative directory listings in DynamoDBMetadataStore.
DescendantsIterator	DescendantsIterator is a RemoteIterator that implements pre-ordering breadth-first traversal (BFS) of a path and all of its descendants recursively.
DirListingMetadata	DirListingMetadata models a directory listing stored in a MetadataStore.
DynamoDBClientFactory.DefaultDynamoDBClientFactory	The default implementation for creating an AmazonDynamoDB.
DynamoDBMetadataStore	DynamoDBMetadataStore is a MetadataStore that persists file system metadata to DynamoDB.
LocalMetadataEntry	LocalMetadataEntry is used to store entries in the cache of LocalMetadataStore.
LocalMetadataStore	This is a local, in-memory implementation of MetadataStore.
MetadataStoreCapabilities	All the capability constants used for the MetadataStore implementations.
MetadataStoreListFilesIterator	MetadataStoreListFilesIterator is a RemoteIterator that is similar to DescendantsIterator but does not return directories that have (or may have) children, and will also provide access to the set of tombstones to allow recently deleted S3 objects to be filtered out from a corresponding request.
NullMetadataStore	A no-op implementation of MetadataStore.
PathMetadata	PathMetadata models path metadata stored in the MetadataStore.
S3Guard	Logic for integrating MetadataStore with S3A.
S3GuardDataAccessRetryPolicy	A Retry policy whose throttling comes from the S3Guard config options.
S3GuardTool	CLI to manage S3Guard Metadata Store.

Package org.apache.hadoop.fs.s3a.s3guard Description

This package contains classes related to S3Guard: a feature of S3A to mask the eventual consistency behavior of S3 and optimize access patterns by coordinating with a strongly consistent external store for file system metadata.