| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.auth.delegation |
Extensible delegation token support for the S3A connector.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| Modifier and Type | Method and Description |
|---|---|
StoreContext |
S3AFileSystem.createStoreContext()
Build an immutable store context.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
S3AFileSystem.CopyFromLocalCallbacksImpl.createEmptyDir(org.apache.hadoop.fs.Path path,
StoreContext storeContext) |
| Constructor and Description |
|---|
Listing(ListingOperationCallbacks listingOperationCallbacks,
StoreContext storeContext) |
UploadIterator(StoreContext storeContext,
com.amazonaws.services.s3.AmazonS3 s3,
int maxKeys,
String prefix) |
| Modifier and Type | Method and Description |
|---|---|
protected StoreContext |
AbstractDTService.getStoreContext() |
| Modifier and Type | Method and Description |
|---|---|
void |
AbstractDTService.bindToFileSystem(URI uri,
StoreContext context,
DelegationOperations delegationOperations)
Bind to the filesystem.
|
void |
S3ADelegationTokens.bindToFileSystem(URI uri,
StoreContext context,
DelegationOperations delegationOperations) |
| Modifier and Type | Method and Description |
|---|---|
StoreContext |
StoreContextBuilder.build() |
StoreContext |
AbstractStoreOperation.getStoreContext()
Get the store context.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
CopyFromLocalOperation.CopyFromLocalOperationCallbacks.createEmptyDir(org.apache.hadoop.fs.Path path,
StoreContext storeContext)
Create empty directory at path.
|
| Constructor and Description |
|---|
AbstractStoreOperation(StoreContext storeContext)
Constructor.
|
AbstractStoreOperation(StoreContext storeContext,
org.apache.hadoop.fs.store.audit.AuditSpan auditSpan)
Constructor.
|
BulkDeleteRetryHandler(StoreContext storeContext)
Constructor.
|
CopyFromLocalOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
org.apache.hadoop.fs.Path destination,
boolean deleteSource,
boolean overwrite,
CopyFromLocalOperation.CopyFromLocalOperationCallbacks callbacks) |
DeleteOperation(StoreContext context,
S3AFileStatus status,
boolean recursive,
OperationCallbacks callbacks,
int pageSize)
Constructor.
|
ExecutingStoreOperation(StoreContext storeContext)
Constructor.
|
ExecutingStoreOperation(StoreContext storeContext,
org.apache.hadoop.fs.store.audit.AuditSpan auditSpan)
Constructor.
|
GetContentSummaryOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path path,
GetContentSummaryOperation.GetContentSummaryCallbacks callbacks)
Constructor.
|
HeaderProcessing(StoreContext storeContext,
HeaderProcessing.HeaderProcessingCallbacks callbacks)
Construct.
|
MkdirOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path dir,
MkdirOperation.MkdirCallbacks callbacks) |
MultiObjectDeleteSupport(StoreContext context,
BulkOperationState operationState)
Initiate with a store context.
|
RenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path sourcePath,
String sourceKey,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path destPath,
String destKey,
S3AFileStatus destStatus,
OperationCallbacks callbacks,
int pageSize)
Initiate the rename.
|
S3AMultipartUploaderBuilder(S3AFileSystem fileSystem,
WriteOperations writeOperations,
StoreContext context,
org.apache.hadoop.fs.Path p,
S3AMultipartUploaderStatistics statistics) |
| Modifier and Type | Method and Description |
|---|---|
RenameTracker |
DynamoDBMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest)
Initiate the rename operation by creating the tracker for the filesystem
to keep up to date with state changes in the S3A bucket.
|
RenameTracker |
LocalMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest) |
RenameTracker |
MetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest)
Start a rename operation.
|
RenameTracker |
NullMetadataStore.initiateRenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path source,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path dest) |
| Constructor and Description |
|---|
AuthoritativeAuditOperation(StoreContext storeContext,
DynamoDBMetadataStore metastore,
boolean requireAuthoritative,
boolean verbose)
Constructor.
|
DelayedUpdateRenameTracker(StoreContext storeContext,
MetadataStore metadataStore,
org.apache.hadoop.fs.Path sourceRoot,
org.apache.hadoop.fs.Path dest,
BulkOperationState operationState) |
ProgressiveRenameTracker(StoreContext storeContext,
MetadataStore metadataStore,
org.apache.hadoop.fs.Path sourceRoot,
org.apache.hadoop.fs.Path dest,
BulkOperationState operationState) |
RenameTracker(String name,
StoreContext storeContext,
MetadataStore metadataStore,
org.apache.hadoop.fs.Path sourceRoot,
org.apache.hadoop.fs.Path dest,
BulkOperationState operationState)
Constructor.
|
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.