| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.prefetch |
High performance s3 input stream which reads in
blocks and can cache blocks in the local filesystem.
|
| Constructor and Description |
|---|
S3AInputStream(S3AReadOpContext ctx,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ExecutorService boundedThreadPool)
Create the stream.
|
| Modifier and Type | Method and Description |
|---|---|
S3ObjectAttributes |
OperationCallbacks.createObjectAttributes(org.apache.hadoop.fs.Path path,
String eTag,
String versionId,
long len)
Create the attributes of an object for subsequent use.
|
S3ObjectAttributes |
OperationCallbacks.createObjectAttributes(S3AFileStatus fileStatus)
Create the attributes of an object for subsequent use.
|
| Modifier and Type | Method and Description |
|---|---|
software.amazon.awssdk.services.s3.model.CopyObjectResponse |
OperationCallbacks.copyFile(String srcKey,
String destKey,
S3ObjectAttributes srcAttributes,
S3AReadOpContext readContext)
Copy a single object in the bucket via a COPY operation.
|
abstract String |
ChangeDetectionPolicy.getRevisionId(S3ObjectAttributes s3Attributes)
Like {
ChangeDetectionPolicy.getRevisionId(HeadObjectResponse, String)}, but retrieves the
revision identifier from S3ObjectAttributes. |
| Constructor and Description |
|---|
ChangeTracker(String uri,
ChangeDetectionPolicy policy,
ChangeTrackerStatistics versionMismatches,
S3ObjectAttributes s3ObjectAttributes)
Create a change tracker.
|
| Modifier and Type | Method and Description |
|---|---|
protected S3ObjectAttributes |
S3ARemoteInputStream.getS3ObjectAttributes() |
| Modifier and Type | Method and Description |
|---|---|
static String |
S3ARemoteObject.getPath(S3ObjectAttributes s3Attributes)
Gets the path corresponding to the given s3Attributes.
|
| Constructor and Description |
|---|
S3ACachingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3ACachingInputStream class. |
S3AInMemoryInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3AInMemoryInputStream class. |
S3APrefetchingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3APrefetchingInputStream class. |
S3ARemoteInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3ARemoteInputStream class. |
S3ARemoteObject(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ChangeTracker changeTracker)
Initializes a new instance of the
S3ARemoteObject class. |
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.