| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.auth |
Authentication and permissions support.
|
| org.apache.hadoop.fs.s3a.auth.delegation |
Extensible delegation token support for the S3A connector.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| Modifier and Type | Method and Description |
|---|---|
Invoker |
S3AOpContext.getInvoker() |
Invoker |
S3AReadOpContext.getReadInvoker()
Get invoker to use for read operations.
|
Invoker |
S3AOpContext.getS3guardInvoker() |
| Modifier and Type | Method and Description |
|---|---|
protected com.amazonaws.services.s3.model.ObjectMetadata |
S3AFileSystem.getObjectMetadata(String key,
ChangeTracker changeTracker,
Invoker changeInvoker,
String operation)
Request object metadata; increments counters in the process.
|
| Constructor and Description |
|---|
S3AOpContext(boolean isS3GuardEnabled,
Invoker invoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus)
Constructor using common invoker and retry policy.
|
S3AOpContext(boolean isS3GuardEnabled,
Invoker invoker,
Invoker s3guardInvoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus)
Alternate constructor that allows passing in two invokers, the common
one, and another with the S3Guard Retry Policy.
|
S3AReadOpContext(org.apache.hadoop.fs.Path path,
boolean isS3GuardEnabled,
Invoker invoker,
Invoker s3guardInvoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus,
S3AInputPolicy inputPolicy,
ChangeDetectionPolicy changeDetectionPolicy,
long readahead,
org.apache.hadoop.fs.store.audit.AuditSpan auditSpan)
Instantiate.
|
| Modifier and Type | Method and Description |
|---|---|
static STSClientFactory.STSClient |
STSClientFactory.createClientConnection(com.amazonaws.services.securitytoken.AWSSecurityTokenService tokenService,
Invoker invoker)
Create an STS Client instance.
|
static MarshalledCredentials |
MarshalledCredentialBinding.requestSessionCredentials(com.amazonaws.auth.AWSCredentialsProvider parentCredentials,
com.amazonaws.ClientConfiguration awsConf,
String stsEndpoint,
String stsRegion,
int duration,
Invoker invoker)
Request a set of credentials from an STS endpoint.
|
| Modifier and Type | Method and Description |
|---|---|
protected Invoker |
SessionTokenBinding.getInvoker()
Get the invoker for STS calls.
|
| Modifier and Type | Method and Description |
|---|---|
Invoker |
StoreContext.getInvoker() |
| Modifier and Type | Method and Description |
|---|---|
StoreContextBuilder |
StoreContextBuilder.setInvoker(Invoker invoke) |
| Modifier and Type | Method and Description |
|---|---|
Invoker |
DynamoDBMetadataStore.getInvoker()
Get the operation invoker for write operations.
|
| Constructor and Description |
|---|
DynamoDBMetadataStoreTableManager(com.amazonaws.services.dynamodbv2.document.DynamoDB dynamoDB,
String tableName,
String region,
com.amazonaws.services.dynamodbv2.AmazonDynamoDB amazonDynamoDB,
org.apache.hadoop.conf.Configuration conf,
Invoker readOp,
org.apache.hadoop.io.retry.RetryPolicy batchWriteCapacityExceededEvents) |
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.