Skip navigation links
A B C D E F G H I K L M N O P R S T U V W 

A

ACCELERATION_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Determines if S3 client will use the Acceleration Mode, default to false.
ACCELERATION_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
ACCESS_KEY_ID - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure the static access key ID used to access S3FileIO.
ACCESS_POINTS_PREFIX - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by S3FileIO, prefix used for bucket access point configuration.
accessKeyId() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
ACL - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used to configure canned access control list (ACL) for S3 client to use during write.
acl() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
acquire(String, String) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
 
APACHE_CONNECTION_ACQUISITION_TIMEOUT_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the connection acquisition timeout in milliseconds for ApacheHttpClient.Builder.
APACHE_CONNECTION_MAX_IDLE_TIME_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the connection max idle time in milliseconds for ApacheHttpClient.Builder.
APACHE_CONNECTION_TIME_TO_LIVE_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the connection time to live in milliseconds for ApacheHttpClient.Builder.
APACHE_CONNECTION_TIMEOUT_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the connection timeout in milliseconds for ApacheHttpClient.Builder.
APACHE_EXPECT_CONTINUE_ENABLED - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure whether to enable the expect continue setting for ApacheHttpClient.Builder.
APACHE_MAX_CONNECTIONS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the max connections number for ApacheHttpClient.Builder.
APACHE_SOCKET_TIMEOUT_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the socket timeout in milliseconds for ApacheHttpClient.Builder.
APACHE_TCP_KEEP_ALIVE_ENABLED - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure whether to enable the tcp keep alive setting for ApacheHttpClient.Builder.
APACHE_USE_IDLE_CONNECTION_REAPER_ENABLED - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure whether to use idle connection reaper for ApacheHttpClient.Builder.
applyAssumeRoleConfigurations(T) - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
applyClientCredentialConfigurations(T) - Method in class org.apache.iceberg.aws.AwsClientProperties
Configure the credential provider for AWS clients.
applyClientCredentialConfigurations(T) - Method in class org.apache.iceberg.aws.AwsProperties
Deprecated.
applyClientRegionConfiguration(T) - Method in class org.apache.iceberg.aws.AwsClientProperties
Configure a client AWS region.
applyCredentialConfigurations(AwsClientProperties, T) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
applyDynamoDbEndpointConfigurations(T) - Method in class org.apache.iceberg.aws.AwsProperties
Override the endpoint for a dynamoDb client.
applyEndpointConfigurations(T) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
Override the endpoint for an S3 client.
applyGlueEndpointConfigurations(T) - Method in class org.apache.iceberg.aws.AwsProperties
Override the endpoint for a glue client.
applyHttpClientConfigurations(T) - Method in class org.apache.iceberg.aws.HttpClientProperties
Configure the httpClient for a client according to the HttpClientType.
applyServiceConfigurations(T) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure services settings for an S3 client.
applySignerConfiguration(T) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure a signer for an S3 client.
AssumeRoleAwsClientFactory - Class in org.apache.iceberg.aws
 
AssumeRoleAwsClientFactory() - Constructor for class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
AwsClientFactories - Class in org.apache.iceberg.aws
 
AwsClientFactory - Interface in org.apache.iceberg.aws
Interface to customize AWS clients used by Iceberg.
AwsClientProperties - Class in org.apache.iceberg.aws
 
AwsClientProperties() - Constructor for class org.apache.iceberg.aws.AwsClientProperties
 
AwsClientProperties(Map<String, String>) - Constructor for class org.apache.iceberg.aws.AwsClientProperties
 
awsProperties() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
AwsProperties - Class in org.apache.iceberg.aws
 
AwsProperties() - Constructor for class org.apache.iceberg.aws.AwsProperties
 
AwsProperties(Map<String, String>) - Constructor for class org.apache.iceberg.aws.AwsProperties
 

B

baseSignerUri() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
body() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
bucketToAccessPointMapping() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 

C

calculateContentHashPresign(SdkHttpFullRequest.Builder, Aws4PresignerParams) - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
check() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
CHECKSUM_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Enables eTag checks for S3 PUT and MULTIPART upload requests.
CHECKSUM_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
client() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
CLIENT_ASSUME_ROLE_ARN - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_EXTERNAL_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_REGION - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_SESSION_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_TAGS_PREFIX - Static variable in class org.apache.iceberg.aws.AwsProperties
Used by AssumeRoleAwsClientFactory to pass a list of sessions.
CLIENT_ASSUME_ROLE_TIMEOUT_SEC - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_TIMEOUT_SEC_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
CLIENT_CREDENTIAL_PROVIDER_PREFIX - Static variable in class org.apache.iceberg.aws.AwsClientProperties
Used by the client.credentials-provider configured value that will be used by AwsClientFactories.defaultFactory() and other AWS client factory classes to pass provider-specific properties.
CLIENT_CREDENTIALS_PROVIDER - Static variable in class org.apache.iceberg.aws.AwsClientProperties
Configure the AWS credentials provider used to create AWS clients.
CLIENT_FACTORY - Static variable in class org.apache.iceberg.aws.AwsProperties
The implementation class of AwsClientFactory to customize AWS client configurations.
CLIENT_FACTORY - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
This property is used to pass in the aws client factory implementation class for S3 FileIO.
CLIENT_REGION - Static variable in class org.apache.iceberg.aws.AwsClientProperties
Used by AwsClientFactories.DefaultAwsClientFactory and also other client factory classes.
CLIENT_TYPE - Static variable in class org.apache.iceberg.aws.HttpClientProperties
The type of SdkHttpClient implementation used by AwsClientFactory If set, all AWS clients will use this specified HTTP client.
CLIENT_TYPE_APACHE - Static variable in class org.apache.iceberg.aws.HttpClientProperties
If this is set under HttpClientProperties.CLIENT_TYPE, ApacheHttpClient will be used as the HTTP Client in AwsClientFactory
CLIENT_TYPE_DEFAULT - Static variable in class org.apache.iceberg.aws.HttpClientProperties
 
CLIENT_TYPE_URLCONNECTION - Static variable in class org.apache.iceberg.aws.HttpClientProperties
If this is set under HttpClientProperties.CLIENT_TYPE, UrlConnectionHttpClient will be used as the HTTP Client in AwsClientFactory
clientAssumeRoleArn() - Method in class org.apache.iceberg.aws.AwsProperties
 
clientAssumeRoleExternalId() - Method in class org.apache.iceberg.aws.AwsProperties
 
clientAssumeRoleRegion() - Method in class org.apache.iceberg.aws.AwsProperties
 
clientAssumeRoleSessionName() - Method in class org.apache.iceberg.aws.AwsProperties
 
clientAssumeRoleTimeoutSec() - Method in class org.apache.iceberg.aws.AwsProperties
 
clientRegion() - Method in class org.apache.iceberg.aws.AwsClientProperties
 
clientRegion() - Method in class org.apache.iceberg.aws.AwsProperties
Deprecated.
will be removed in 1.5.0, use AwsClientProperties.clientRegion() instead
close() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
close() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
 
close() - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
close() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
close() - Method in class org.apache.iceberg.aws.util.RetryDetector
 
configureEndpoint(T, String) - Static method in class org.apache.iceberg.aws.AwsClientFactories
configureHttpClientBuilder(String) - Static method in class org.apache.iceberg.aws.AwsClientFactories
Deprecated.
Not for public use. To configure the httpClient for a client, please use HttpClientProperties.applyHttpClientConfigurations(AwsSyncClientBuilder). It will be removed in 2.0.0
create() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
Create an output stream for the specified location if the target object does not exist in S3 at the time of invocation.
create(Map<String, String>) - Static method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
createNamespace(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
createNamespace(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
createOrOverwrite() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 
credential() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
A credential to exchange for a token in the OAuth2 client credentials flow.
credentialsProvider(String, String, String) - Method in class org.apache.iceberg.aws.AwsClientProperties
Returns a credentials provider instance.

D

defaultFactory() - Static method in class org.apache.iceberg.aws.AwsClientFactories
 
defaultLocationProperty() - Static method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
The property used to set a default location for tables in a namespace.
defaultWarehouseLocation(TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
defaultWarehouseLocation(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
This method produces the same result as using a HiveCatalog.
DELETE_BATCH_SIZE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure the batch size used when deleting multiple files from a given S3 bucket
DELETE_BATCH_SIZE_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Default batch size used when deleting files.
DELETE_BATCH_SIZE_MAX - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Max possible batch size for deletion.
DELETE_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Determines if S3FileIO deletes the object when io.delete() is called, default to true.
DELETE_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
DELETE_TAGS_PREFIX - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by S3FileIO to tag objects when deleting.
DELETE_THREADS - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Number of threads to use for adding delete tags to S3 objects, default to Runtime.availableProcessors()
deleteBatchSize() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
deleteFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
deleteFiles(Iterable<String>) - Method in class org.apache.iceberg.aws.s3.S3FileIO
Deletes the given paths in a batched manner.
deletePrefix(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
This method provides a "best-effort" to delete all objects under the given prefix.
deleteTags() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
deleteThreads() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
deserialize(JsonParser, DeserializationContext) - Method in class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignRequestDeserializer
 
deserialize(JsonParser, DeserializationContext) - Method in class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignResponseDeserializer
 
dropNamespace(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
dropNamespace(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
dropTable(TableIdentifier, boolean) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
dropTable(TableIdentifier, boolean) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
DUALSTACK_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Determines if S3 client will use the Dualstack Mode, default to false.
DUALSTACK_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
dynamo() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
dynamo() - Method in interface org.apache.iceberg.aws.AwsClientFactory
Create a Amazon DynamoDB client
DYNAMODB_ENDPOINT - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure an alternative endpoint of the DynamoDB service to access.
DYNAMODB_TABLE_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
DynamoDB table name for DynamoDbCatalog
DYNAMODB_TABLE_NAME_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
DynamoDbCatalog - Class in org.apache.iceberg.aws.dynamodb
DynamoDB implementation of Iceberg catalog
DynamoDbCatalog() - Constructor for class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
DynamoDbLockManager - Class in org.apache.iceberg.aws.dynamodb
DynamoDB implementation for the lock manager.
DynamoDbLockManager() - Constructor for class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
constructor for dynamic initialization, DynamoDbLockManager.initialize(Map) must be called later.
DynamoDbLockManager(DynamoDbClient, String) - Constructor for class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
constructor used for testing purpose
dynamoDbTableName() - Method in class org.apache.iceberg.aws.AwsProperties
 

E

ENDPOINT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure an alternative endpoint of the S3 service for S3FileIO to access.
endpoint() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
endpoint() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 

F

finalize() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
from(Map<String, String>) - Static method in class org.apache.iceberg.aws.AwsClientFactories
 
fromJson(String) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignRequestParser
 
fromJson(JsonNode) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignRequestParser
 
fromJson(String) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignResponseParser
 
fromJson(JsonNode) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignResponseParser
 
fromLocation(String, S3Client, S3FileIOProperties, MetricsContext) - Static method in class org.apache.iceberg.aws.s3.S3InputFile
 
fromLocation(String, long, S3Client, S3FileIOProperties, MetricsContext) - Static method in class org.apache.iceberg.aws.s3.S3InputFile
 
fromLocation(String, S3Client, S3FileIOProperties, MetricsContext) - Static method in class org.apache.iceberg.aws.s3.S3OutputFile
 

G

getConf() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
getCredential() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
getLength() - Method in class org.apache.iceberg.aws.s3.S3InputFile
Note: this may be stale if file was deleted since metadata is cached for size/existence checks.
glue() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
glue() - Method in interface org.apache.iceberg.aws.AwsClientFactory
create a AWS Glue client
GLUE_ACCOUNT_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
The account ID used in a Glue resource ARN, e.g.
GLUE_CATALOG_ENDPOINT - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure an alternative endpoint of the Glue service for GlueCatalog to access.
GLUE_CATALOG_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
The ID of the Glue Data Catalog where the tables reside.
GLUE_CATALOG_SKIP_ARCHIVE - Static variable in class org.apache.iceberg.aws.AwsProperties
If Glue should skip archiving an old table version when creating a new version in a commit.
GLUE_CATALOG_SKIP_ARCHIVE_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
GLUE_CATALOG_SKIP_NAME_VALIDATION - Static variable in class org.apache.iceberg.aws.AwsProperties
If Glue should skip name validations It is recommended to stick to Glue best practice in https://docs.aws.amazon.com/athena/latest/ug/glue-best-practices.html to make sure operations are Hive compatible.
GLUE_CATALOG_SKIP_NAME_VALIDATION_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
GLUE_LAKEFORMATION_ENABLED - Static variable in class org.apache.iceberg.aws.AwsProperties
If set, GlueCatalog will use Lake Formation for access control.
GLUE_LAKEFORMATION_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
GlueCatalog - Class in org.apache.iceberg.aws.glue
 
GlueCatalog() - Constructor for class org.apache.iceberg.aws.glue.GlueCatalog
No-arg constructor to load the catalog dynamically.
glueCatalogId() - Method in class org.apache.iceberg.aws.AwsProperties
 
glueCatalogSkipArchive() - Method in class org.apache.iceberg.aws.AwsProperties
 
glueCatalogSkipNameValidation() - Method in class org.apache.iceberg.aws.AwsProperties
 
glueLakeFormationEnabled() - Method in class org.apache.iceberg.aws.AwsProperties
 

H

headers() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
headers() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignResponse
 
httpClientProperties() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
httpClientProperties() - Method in class org.apache.iceberg.aws.AwsProperties
Deprecated.
will be removed in 1.5.0, use HttpClientProperties instead
HttpClientProperties - Class in org.apache.iceberg.aws
 
HttpClientProperties() - Constructor for class org.apache.iceberg.aws.HttpClientProperties
 
HttpClientProperties(Map<String, String>) - Constructor for class org.apache.iceberg.aws.HttpClientProperties
 

I

initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
initialize(Map<String, String>) - Method in interface org.apache.iceberg.aws.AwsClientFactory
Initialize AWS client factory from catalog properties.
initialize(String, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
 
initialize(String, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.lakeformation.LakeFormationAwsClientFactory
 
initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.RESTSigV4Signer
 
initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
initialize(Map<String, String>) - Method in interface org.apache.iceberg.aws.s3.S3FileIOAwsClientFactory
Initialize AWS client factory from catalog properties.
initialize(Map<String, String>) - Static method in class org.apache.iceberg.aws.S3FileIOAwsClientFactories
Attempts to load an AWS client factory class for S3 file IO defined in the catalog property S3FileIOProperties.CLIENT_FACTORY.
initModule() - Static method in class org.apache.iceberg.aws.s3.signer.S3ObjectMapper
 
isAccelerationEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isChecksumEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isDeleteEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isDualStackEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isPathStyleAccess() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isPreloadClientEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isRemoteSigningEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isUseArnRegionEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
isValidIdentifier(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
isWriteNamespaceTagEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 

K

kms() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
kms() - Method in interface org.apache.iceberg.aws.AwsClientFactory
Create a AWS KMS client
kms() - Method in class org.apache.iceberg.aws.lakeformation.LakeFormationAwsClientFactory
 

L

LAKE_FORMATION_DB_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
LAKE_FORMATION_TABLE_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
LakeFormationAwsClientFactory - Class in org.apache.iceberg.aws.lakeformation
This implementation of AwsClientFactory is used by default if AwsProperties.GLUE_LAKEFORMATION_ENABLED is set to true.
LakeFormationAwsClientFactory() - Constructor for class org.apache.iceberg.aws.lakeformation.LakeFormationAwsClientFactory
 
LF_AUTHORIZED_CALLER - Static variable in class org.apache.iceberg.aws.lakeformation.LakeFormationAwsClientFactory
 
listNamespaces(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
listNamespaces(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
listPrefix(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
listTables(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
listTables(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
loadNamespaceMetadata(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
loadNamespaceMetadata(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
lockTableColDefinitions() - Static method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
The lock table column definition, for users who whould like to create the table separately
lockTableSchema() - Static method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
The lock table schema, for users who would like to create the table separately

M

method() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
MULTIPART_SIZE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
The size of a single part for multipart upload requests in bytes (default: 32MB).
MULTIPART_SIZE_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
MULTIPART_SIZE_MIN - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
MULTIPART_THRESHOLD_FACTOR - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
The threshold expressed as a factor times the multipart size at which to switch from uploading using a single put object request to uploading using multipart upload (default: 1.5).
MULTIPART_THRESHOLD_FACTOR_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
MULTIPART_UPLOAD_THREADS - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Number of threads to use for uploading parts to S3 (shared pool across all output streams), default to Runtime.availableProcessors()
multiPartSize() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
multipartThresholdFactor() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
multipartUploadThreads() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 

N

name() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
name() - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
nativeCryptoParameters() - Method in class org.apache.iceberg.aws.s3.S3InputFile
 
nativeCryptoParameters() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 
newInputFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
newInputFile(String, long) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
newOutputFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
newStream() - Method in class org.apache.iceberg.aws.s3.S3InputFile
 
newTableOps(TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
newTableOps(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 

O

org.apache.iceberg.aws - package org.apache.iceberg.aws
 
org.apache.iceberg.aws.dynamodb - package org.apache.iceberg.aws.dynamodb
 
org.apache.iceberg.aws.glue - package org.apache.iceberg.aws.glue
 
org.apache.iceberg.aws.lakeformation - package org.apache.iceberg.aws.lakeformation
 
org.apache.iceberg.aws.s3 - package org.apache.iceberg.aws.s3
 
org.apache.iceberg.aws.s3.signer - package org.apache.iceberg.aws.s3.signer
 
org.apache.iceberg.aws.util - package org.apache.iceberg.aws.util
 

P

PATH_STYLE_ACCESS - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
If set true, requests to S3FileIO will use Path-Style, otherwise, Virtual Hosted-Style will be used.
PATH_STYLE_ACCESS_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
PRELOAD_CLIENT_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
This flag controls whether the S3 client will be initialized during the S3FileIO initialization, instead of default lazy initialization upon use.
PRELOAD_CLIENT_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
presign(SdkHttpFullRequest, ExecutionAttributes) - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
process(HttpRequest, EntityDetails, HttpContext) - Method in class org.apache.iceberg.aws.RESTSigV4Signer
 
processRequestPayload(SdkHttpFullRequest.Builder, byte[], byte[], Aws4SignerRequestParams, AwsS3V4SignerParams) - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
processRequestPayload(SdkHttpFullRequest.Builder, byte[], byte[], Aws4SignerRequestParams, AwsS3V4SignerParams, SdkChecksum) - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
properties() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
properties() - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
properties() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
properties() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
properties() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
publish(MetricCollection) - Method in class org.apache.iceberg.aws.util.RetryDetector
 

R

region() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
region() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
release(String, String) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbLockManager
 
REMOTE_SIGNING_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
REMOTE_SIGNING_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
removeProperties(Namespace, Set<String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
removeProperties(Namespace, Set<String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
renameTable(TableIdentifier, TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
renameTable(TableIdentifier, TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
Rename table in Glue is a drop table and create table.
requestPropertiesSupplier() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
REST_ACCESS_KEY_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static access key ID used for SigV4 signing.
REST_SECRET_ACCESS_KEY - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static secret access key used for SigV4 signing.
REST_SESSION_TOKEN - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static session token used for SigV4.
REST_SIGNER_REGION - Static variable in class org.apache.iceberg.aws.AwsProperties
Region to be used by the SigV4 protocol for signing requests.
REST_SIGNING_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
The service name to be used by the SigV4 protocol for signing requests.
REST_SIGNING_NAME_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
The default service name (API Gateway and lambda) used during SigV4 signing.
restCredentialsProvider() - Method in class org.apache.iceberg.aws.AwsProperties
 
restSigningName() - Method in class org.apache.iceberg.aws.AwsProperties
 
restSigningRegion() - Method in class org.apache.iceberg.aws.AwsProperties
 
RESTSigV4Signer - Class in org.apache.iceberg.aws
Provides a request interceptor for use with the HTTPClient that calculates the required signature for the SigV4 protocol and adds the necessary headers for all requests created by the client.
RESTSigV4Signer() - Constructor for class org.apache.iceberg.aws.RESTSigV4Signer
 
retried() - Method in class org.apache.iceberg.aws.util.RetryDetector
 
RetryDetector - Class in org.apache.iceberg.aws.util
Metrics are the only reliable way provided by the AWS SDK to determine if an API call was retried.
RetryDetector() - Constructor for class org.apache.iceberg.aws.util.RetryDetector
 

S

s3() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
s3() - Method in interface org.apache.iceberg.aws.AwsClientFactory
create a Amazon S3 client
s3() - Method in class org.apache.iceberg.aws.lakeformation.LakeFormationAwsClientFactory
 
s3() - Method in interface org.apache.iceberg.aws.s3.S3FileIOAwsClientFactory
create a Amazon S3 client
S3_SIGNER_ENDPOINT - Static variable in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
S3_SIGNER_URI - Static variable in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
S3_TAG_ICEBERG_NAMESPACE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
S3_TAG_ICEBERG_TABLE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
s3Configuration(Boolean, Boolean) - Static method in class org.apache.iceberg.aws.AwsClientFactories
Deprecated.
Not for public use. To build an S3Configuration object, use S3Configuration.builder() directly. It will be removed in 2.0.0
S3FileIO - Class in org.apache.iceberg.aws.s3
FileIO implementation backed by S3.
S3FileIO() - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
No-arg constructor to load the FileIO dynamically.
S3FileIO(SerializableSupplier<S3Client>) - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
Constructor with custom s3 supplier and S3FileIO properties.
S3FileIO(SerializableSupplier<S3Client>, S3FileIOProperties) - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
Constructor with custom s3 supplier and S3FileIO properties.
S3FileIOAwsClientFactories - Class in org.apache.iceberg.aws
 
S3FileIOAwsClientFactory - Interface in org.apache.iceberg.aws.s3
 
s3FileIOProperties() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
S3FileIOProperties - Class in org.apache.iceberg.aws.s3
 
S3FileIOProperties() - Constructor for class org.apache.iceberg.aws.s3.S3FileIOProperties
 
S3FileIOProperties(Map<String, String>) - Constructor for class org.apache.iceberg.aws.s3.S3FileIOProperties
 
S3InputFile - Class in org.apache.iceberg.aws.s3
 
S3ObjectMapper - Class in org.apache.iceberg.aws.s3.signer
 
S3ObjectMapper.S3SignRequestDeserializer<T extends S3SignRequest> - Class in org.apache.iceberg.aws.s3.signer
 
S3ObjectMapper.S3SignRequestSerializer<T extends S3SignRequest> - Class in org.apache.iceberg.aws.s3.signer
 
S3ObjectMapper.S3SignResponseDeserializer<T extends S3SignResponse> - Class in org.apache.iceberg.aws.s3.signer
 
S3ObjectMapper.S3SignResponseSerializer<T extends S3SignResponse> - Class in org.apache.iceberg.aws.s3.signer
 
S3OutputFile - Class in org.apache.iceberg.aws.s3
 
S3RequestUtil - Class in org.apache.iceberg.aws.s3
 
S3SignRequest - Interface in org.apache.iceberg.aws.s3.signer
 
S3SignRequestDeserializer() - Constructor for class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignRequestDeserializer
 
S3SignRequestParser - Class in org.apache.iceberg.aws.s3.signer
 
S3SignRequestSerializer() - Constructor for class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignRequestSerializer
 
S3SignResponse - Interface in org.apache.iceberg.aws.s3.signer
 
S3SignResponseDeserializer() - Constructor for class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignResponseDeserializer
 
S3SignResponseParser - Class in org.apache.iceberg.aws.s3.signer
 
S3SignResponseSerializer() - Constructor for class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignResponseSerializer
 
S3V4RestSignerClient - Class in org.apache.iceberg.aws.s3.signer
 
S3V4RestSignerClient() - Constructor for class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
SECRET_ACCESS_KEY - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure the static secret access key used to access S3FileIO.
secretAccessKey() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
serialize(T, JsonGenerator, SerializerProvider) - Method in class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignRequestSerializer
 
serialize(T, JsonGenerator, SerializerProvider) - Method in class org.apache.iceberg.aws.s3.signer.S3ObjectMapper.S3SignResponseSerializer
 
SESSION_TOKEN - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Configure the static session token used to access S3FileIO.
sessionToken() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setAcl(ObjectCannedACL) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setChecksumEnabled(boolean) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setClientRegion(String) - Method in class org.apache.iceberg.aws.AwsClientProperties
 
setClientRegion(String) - Method in class org.apache.iceberg.aws.AwsProperties
Deprecated.
will be removed in 1.5.0, use AwsClientProperties.setClientRegion(String) instead
setConf(Configuration) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
setConf(Configuration) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
setDeleteBatchSize(int) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setDeleteEnabled(boolean) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setDeleteThreads(int) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setDynamoDbTableName(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueCatalogId(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueCatalogSkipArchive(boolean) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueCatalogSkipNameValidation(boolean) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueLakeFormationEnabled(boolean) - Method in class org.apache.iceberg.aws.AwsProperties
 
setMultiPartSize(int) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setMultipartThresholdFactor(double) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setMultipartUploadThreads(int) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setNativeCryptoParameters(NativeFileCryptoParameters) - Method in class org.apache.iceberg.aws.s3.S3InputFile
 
setNativeCryptoParameters(NativeFileCryptoParameters) - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 
setPreloadClientEnabled(boolean) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setProperties(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
setProperties(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
setSseKey(String) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setSseMd5(String) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setSseType(String) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setStagingDirectory(String) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setWriteNamespaceTagEnabled(boolean) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
setWriteTableTagEnabled(boolean) - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
sign(SdkHttpFullRequest, ExecutionAttributes) - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
 
SSE_KEY - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
If S3 encryption type is SSE-KMS, input is a KMS Key ID or ARN.
SSE_MD5 - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
If S3 encryption type is SSE-C, input is the base-64 MD5 digest of the secret key.
SSE_TYPE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Type of S3 Server side encryption used, default to S3FileIOProperties.SSE_TYPE_NONE.
SSE_TYPE_CUSTOM - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
S3 SSE-C encryption.
SSE_TYPE_KMS - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
S3 SSE-KMS encryption.
SSE_TYPE_NONE - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
No server side encryption.
SSE_TYPE_S3 - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
S3 SSE-S3 encryption.
sseKey() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
sseMd5() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
sseType() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
STAGING_DIRECTORY - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Location to put staging files for upload to S3, default to temp directory set in java.io.tmpdir.
stagingDirectory() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
stsClientAssumeRoleTags() - Method in class org.apache.iceberg.aws.AwsProperties
 

T

toInputFile() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 
toJson(S3SignRequest) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignRequestParser
 
toJson(S3SignRequest, boolean) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignRequestParser
 
toJson(S3SignRequest, JsonGenerator) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignRequestParser
 
toJson(S3SignResponse) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignResponseParser
 
toJson(S3SignResponse, boolean) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignResponseParser
 
toJson(S3SignResponse, JsonGenerator) - Static method in class org.apache.iceberg.aws.s3.signer.S3SignResponseParser
 
token() - Method in class org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient
A Bearer token supplier which will be used for interaction with the server.

U

uri() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
uri() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignResponse
 
URLCONNECTION_CONNECTION_TIMEOUT_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the connection timeout in milliseconds for UrlConnectionHttpClient.Builder.
URLCONNECTION_SOCKET_TIMEOUT_MS - Static variable in class org.apache.iceberg.aws.HttpClientProperties
Used to configure the socket timeout in milliseconds for UrlConnectionHttpClient.Builder.
USE_ARN_REGION_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Enable to make S3FileIO, to make cross-region call to the region specified in the ARN of an access point.
USE_ARN_REGION_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 

V

validate() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignRequest
 
validate() - Method in interface org.apache.iceberg.aws.s3.signer.S3SignResponse
 

W

WRITE_NAMESPACE_TAG_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by GlueCatalog to tag objects when writing.
WRITE_NAMESPACE_TAG_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
WRITE_STORAGE_CLASS - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by S3FileIO to tag objects' storage class when writing.
WRITE_TABLE_TAG_ENABLED - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by GlueCatalog to tag objects when writing.
WRITE_TABLE_TAG_ENABLED_DEFAULT - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
WRITE_TAGS_PREFIX - Static variable in class org.apache.iceberg.aws.s3.S3FileIOProperties
Used by S3FileIO to tag objects when writing.
writeStorageClass() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
writeTableTagEnabled() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
writeTags() - Method in class org.apache.iceberg.aws.s3.S3FileIOProperties
 
A B C D E F G H I K L M N O P R S T U V W 
Skip navigation links