| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.auth |
Authentication and permissions support.
|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| org.apache.hadoop.fs.s3a.select |
Support for S3 Select.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<org.apache.hadoop.fs.LocatedFileStatus> |
S3AFileSystem.listLocatedStatus(org.apache.hadoop.fs.Path f,
org.apache.hadoop.fs.PathFilter filter)
.
|
com.amazonaws.services.s3.model.UploadPartRequest |
WriteOperationHelper.newUploadPartRequest(String destKey,
String uploadId,
int partNumber,
int size,
InputStream uploadStream,
File sourceFile,
Long offset)
Create and initialize a part request of a multipart upload.
|
static <T> T |
Invoker.once(String action,
String path,
org.apache.hadoop.util.functional.CallableRaisingIOE<T> operation)
Execute a function, translating any exception into an IOException.
|
static void |
Invoker.once(String action,
String path,
org.apache.hadoop.util.functional.InvocationRaisingIOE operation)
Execute an operation with no result.
|
void |
WriteOperationHelper.revertCommit(String destKey,
BulkOperationState operationState)
Revert a commit by deleting the file.
|
void |
WriteOperations.revertCommit(String destKey,
BulkOperationState operationState)
Revert a commit by deleting the file.
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
AbstractSessionCredentialsProvider.init()
Initialize the credentials by calling
AbstractSessionCredentialsProvider.createCredentials(Configuration) with the current config. |
| Modifier and Type | Method and Description |
|---|---|
static MetadataStore |
S3Guard.getMetadataStore(org.apache.hadoop.fs.FileSystem fs,
ITtlTimeProvider ttlTimeProvider)
Create a new instance of the configured MetadataStore.
|
| Modifier and Type | Method and Description |
|---|---|
int |
SelectInputStream.read()
Read a byte.
|
int |
SelectInputStream.read(byte[] buf,
int off,
int len) |
void |
SelectInputStream.seek(long newPos)
Forward seeks are supported, but not backwards ones.
|
long |
SelectInputStream.skip(long n) |
| Constructor and Description |
|---|
SelectInputStream(S3AReadOpContext readContext,
S3ObjectAttributes objectAttributes,
com.amazonaws.services.s3.model.SelectObjectContentResult selectResponse)
Create the stream.
|
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.