| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.audit |
Support for auditing and ultimately tracing operations.
|
| org.apache.hadoop.fs.s3a.audit.impl |
The internal implementations of auditing support.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.tools |
S3A Command line tools independent of S3Guard.
|
| Modifier and Type | Method and Description |
|---|---|
static S3AFileStatus |
S3AUtils.createFileStatus(org.apache.hadoop.fs.Path keyPath,
software.amazon.awssdk.services.s3.model.S3Object s3Object,
long blockSize,
String owner,
String eTag,
String versionId,
boolean isCSEEnabled)
Create a files status instance from a listing.
|
static S3AFileStatus |
S3AUtils.createUploadFileStatus(org.apache.hadoop.fs.Path keyPath,
boolean isDir,
long size,
long blockSize,
String owner,
String eTag,
String versionId)
Create a file status for object we just uploaded.
|
static S3AFileStatus |
S3AFileStatus.fromFileStatus(org.apache.hadoop.fs.FileStatus source,
Tristate isEmptyDirectory,
String eTag,
String versionId)
Convenience constructor for creating from a vanilla FileStatus plus
an isEmptyDirectory flag.
|
static S3AFileStatus[] |
S3AUtils.iteratorToStatuses(org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> iterator)
Convert the data of an iterator of
S3AFileStatus to
an array. |
S3AFileStatus |
S3AFileSystem.MkdirOperationCallbacksImpl.probePathStatus(org.apache.hadoop.fs.Path path,
Set<StatusProbeEnum> probes) |
S3AFileStatus |
S3AFileSystem.GetContentSummaryCallbacksImpl.probePathStatus(org.apache.hadoop.fs.Path path,
Set<StatusProbeEnum> probes) |
S3AFileStatus |
S3ALocatedFileStatus.toS3AFileStatus()
Generate an S3AFileStatus instance, including etag and
version ID, if present.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
Listing.getFileStatusesAssumingNonEmptyDir(org.apache.hadoop.fs.Path path,
org.apache.hadoop.fs.store.audit.AuditSpan span)
Calculate list of file statuses assuming path
to be a non-empty directory.
|
static org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
Listing.toProvidedFileStatusIterator(S3AFileStatus[] fileStatuses)
Create a FileStatus iterator against a provided list of file status.
|
| Modifier and Type | Method and Description |
|---|---|
S3ALocatedFileStatus |
S3AFileSystem.ListingOperationCallbacksImpl.toLocatedFileStatus(S3AFileStatus status) |
static org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
Listing.toProvidedFileStatusIterator(S3AFileStatus[] fileStatuses)
Create a FileStatus iterator against a provided list of file status.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<S3ALocatedFileStatus> |
Listing.createLocatedFileStatusIterator(org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> statusIterator)
Create a located status iterator over a file status iterator.
|
static S3AFileStatus[] |
S3AUtils.iteratorToStatuses(org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> iterator)
Convert the data of an iterator of
S3AFileStatus to
an array. |
| Constructor and Description |
|---|
S3ALocatedFileStatus(S3AFileStatus status,
org.apache.hadoop.fs.BlockLocation[] locations) |
| Modifier and Type | Method and Description |
|---|---|
default boolean |
OperationAuditor.checkAccess(org.apache.hadoop.fs.Path path,
S3AFileStatus status,
org.apache.hadoop.fs.permission.FsAction mode)
Check for permission to access a path.
|
boolean |
AuditManagerS3A.checkAccess(org.apache.hadoop.fs.Path path,
S3AFileStatus status,
org.apache.hadoop.fs.permission.FsAction mode)
Check for permission to access a path.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
ActiveAuditManagerS3A.checkAccess(org.apache.hadoop.fs.Path path,
S3AFileStatus status,
org.apache.hadoop.fs.permission.FsAction mode) |
boolean |
NoopAuditManagerS3A.checkAccess(org.apache.hadoop.fs.Path path,
S3AFileStatus status,
org.apache.hadoop.fs.permission.FsAction mode)
Forward to the auditor.
|
| Modifier and Type | Method and Description |
|---|---|
S3AFileStatus |
OpenFileSupport.OpenFileInformation.getStatus() |
S3AFileStatus |
MkdirOperation.MkdirCallbacks.probePathStatus(org.apache.hadoop.fs.Path path,
Set<StatusProbeEnum> probes)
Get the status of a path.
|
S3AFileStatus |
GetContentSummaryOperation.GetContentSummaryCallbacks.probePathStatus(org.apache.hadoop.fs.Path path,
Set<StatusProbeEnum> probes)
Get the status of a path.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
OperationCallbacks.listObjects(org.apache.hadoop.fs.Path path,
String key)
Create an iterator over objects in S3.
|
| Modifier and Type | Method and Description |
|---|---|
S3ObjectAttributes |
OperationCallbacks.createObjectAttributes(S3AFileStatus fileStatus)
Create the attributes of an object for subsequent use.
|
String |
StoreContext.fullKey(S3AFileStatus stat)
Build the full S3 key for a request from the status entry,
possibly adding a "/" if it represents directory and it does
not have a trailing slash already.
|
org.apache.hadoop.fs.RemoteIterator<S3ALocatedFileStatus> |
OperationCallbacks.listFilesAndDirectoryMarkers(org.apache.hadoop.fs.Path path,
S3AFileStatus status,
boolean includeSelf)
Recursive list of files and directory markers.
|
S3ALocatedFileStatus |
ListingOperationCallbacks.toLocatedFileStatus(S3AFileStatus status)
Build a
S3ALocatedFileStatus from a FileStatus instance. |
OpenFileSupport.OpenFileInformation |
OpenFileSupport.OpenFileInformation.withStatus(S3AFileStatus value)
Set builder value.
|
| Constructor and Description |
|---|
DeleteOperation(StoreContext context,
S3AFileStatus status,
boolean recursive,
OperationCallbacks callbacks,
int pageSize,
boolean dirOperationsPurgeUploads)
Constructor.
|
RenameOperation(StoreContext storeContext,
org.apache.hadoop.fs.Path sourcePath,
String sourceKey,
S3AFileStatus sourceStatus,
org.apache.hadoop.fs.Path destPath,
String destKey,
S3AFileStatus destStatus,
OperationCallbacks callbacks,
int pageSize,
boolean dirOperationsPurgeUploads)
Initiate the rename.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
MarkerToolOperationsImpl.listObjects(org.apache.hadoop.fs.Path path,
String key) |
org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> |
MarkerToolOperations.listObjects(org.apache.hadoop.fs.Path path,
String key)
Create an iterator over objects in S3.
|
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.