| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.prefetch |
High performance s3 input stream which reads in
blocks and can cache blocks in the local filesystem.
|
| Modifier and Type | Method and Description |
|---|---|
S3AReadOpContext |
S3AReadOpContext.build()
validate the context.
|
protected S3AReadOpContext |
S3AFileSystem.createReadContext(org.apache.hadoop.fs.FileStatus fileStatus,
org.apache.hadoop.fs.store.audit.AuditSpan auditSpan)
Create the read context for reading from the referenced file,
using FS state as well as the status.
|
S3AReadOpContext |
S3AReadOpContext.withAsyncDrainThreshold(long value)
Set builder value.
|
S3AReadOpContext |
S3AReadOpContext.withAuditSpan(org.apache.hadoop.fs.store.audit.AuditSpan value)
Set builder value.
|
S3AReadOpContext |
S3AReadOpContext.withChangeDetectionPolicy(ChangeDetectionPolicy value)
Set builder value.
|
S3AReadOpContext |
S3AReadOpContext.withInputPolicy(S3AInputPolicy value)
Set builder value.
|
S3AReadOpContext |
S3AReadOpContext.withReadahead(long value)
Set builder value.
|
| Constructor and Description |
|---|
S3AInputStream(S3AReadOpContext ctx,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ExecutorService boundedThreadPool)
Create the stream.
|
| Modifier and Type | Method and Description |
|---|---|
S3AReadOpContext |
OpenFileSupport.applyDefaultOptions(S3AReadOpContext roc)
Propagate the default options to the operation context
being built up.
|
S3AReadOpContext |
OpenFileSupport.OpenFileInformation.applyOptions(S3AReadOpContext roc)
Propagate the options to the operation context
being built up.
|
S3AReadOpContext |
OperationCallbacks.createReadContext(org.apache.hadoop.fs.FileStatus fileStatus)
Create the read context for reading from the referenced file,
using FS state as well as the status.
|
| Modifier and Type | Method and Description |
|---|---|
S3AReadOpContext |
OpenFileSupport.applyDefaultOptions(S3AReadOpContext roc)
Propagate the default options to the operation context
being built up.
|
S3AReadOpContext |
OpenFileSupport.OpenFileInformation.applyOptions(S3AReadOpContext roc)
Propagate the options to the operation context
being built up.
|
software.amazon.awssdk.services.s3.model.CopyObjectResponse |
OperationCallbacks.copyFile(String srcKey,
String destKey,
S3ObjectAttributes srcAttributes,
S3AReadOpContext readContext)
Copy a single object in the bucket via a COPY operation.
|
| Modifier and Type | Method and Description |
|---|---|
protected S3AReadOpContext |
S3ARemoteInputStream.getContext() |
| Constructor and Description |
|---|
S3ACachingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3ACachingInputStream class. |
S3AInMemoryInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3AInMemoryInputStream class. |
S3APrefetchingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3APrefetchingInputStream class. |
S3ARemoteInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3ARemoteInputStream class. |
S3ARemoteObject(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ChangeTracker changeTracker)
Initializes a new instance of the
S3ARemoteObject class. |
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.