| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| Modifier and Type | Class and Description |
|---|---|
class |
DelayedUpdateRenameTracker
This is the rename updating strategy originally used:
a collection of source paths and a list of destinations are created,
then updated at the end (possibly slow).
|
class |
ProgressiveRenameTracker
This rename tracker progressively updates the metadata store
as it proceeds, during the parallelized copy operation.
|
| Modifier and Type | Method and Description |
|---|---|
RenameTracker |
DynamoDBMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest)
Initiate the rename operation by creating the tracker for the filesystem
to keep up to date with state changes in the S3A bucket.
|
RenameTracker |
LocalMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest) |
RenameTracker |
MetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest)
Start a rename operation.
|
RenameTracker |
NullMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest) |
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.