software.amazon.awssdk.services.s3.internal.crt

Class DefaultS3CrtAsyncClient.DefaultS3CrtClientBuilder

java.lang.Object

software.amazon.awssdk.services.s3.internal.crt.DefaultS3CrtAsyncClient.DefaultS3CrtClientBuilder

All Implemented Interfaces:

S3CrtAsyncClientBuilder, Buildable, SdkBuilder<S3CrtAsyncClientBuilder,S3AsyncClient>

Enclosing class:

DefaultS3CrtAsyncClient

public static final class DefaultS3CrtAsyncClient.DefaultS3CrtClientBuilder
extends Object
implements S3CrtAsyncClientBuilder

Constructor Summary

Constructors

Constructor and Description
DefaultS3CrtClientBuilder()

Method Summary

Modifier and Type	Method and Description
S3CrtAsyncClient	build()
S3CrtAsyncClientBuilder	checksumValidationEnabled(Boolean checksumValidationEnabled) Option to disable checksum validation for S3AsyncClient.getObject(GetObjectRequest, Path) and S3AsyncClient.putObject(PutObjectRequest, Path).
AwsCredentialsProvider	credentialsProvider()
S3CrtAsyncClientBuilder	credentialsProvider(AwsCredentialsProvider credentialsProvider) Configure the credentials that should be used to authenticate with S3.
URI	endpointOverride()
S3CrtAsyncClientBuilder	endpointOverride(URI endpointOverride) Configure the endpoint override with which the SDK should communicate.
S3CrtAsyncClientBuilder	httpConfiguration(S3CrtHttpConfiguration configuration) Sets the HTTP configuration to use for this client.
S3CrtAsyncClientBuilder	initialReadBufferSizeInBytes(Long readBufferSizeInBytes) Configure the starting buffer size the client will use to buffer the parts downloaded from S3.
Integer	maxConcurrency()
S3CrtAsyncClientBuilder	maxConcurrency(Integer maxConcurrency) Specifies the maximum number of S3 connections that should be established during a transfer.
Long	minimumPartSizeInBytes()
S3CrtAsyncClientBuilder	minimumPartSizeInBytes(Long partSizeBytes) Sets the minimum part size for transfer parts.
Long	readBufferSizeInBytes()
Region	region()
S3CrtAsyncClientBuilder	region(Region region) Configure the region with which the SDK should communicate.
Double	targetThroughputInGbps()
S3CrtAsyncClientBuilder	targetThroughputInGbps(Double targetThroughputInGbps) The target throughput for transfer requests.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface software.amazon.awssdk.services.s3.S3CrtAsyncClientBuilder

httpConfiguration

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation

Constructor Detail

DefaultS3CrtClientBuilder

public DefaultS3CrtClientBuilder()

Method Detail

credentialsProvider

public AwsCredentialsProvider credentialsProvider()

region

public Region region()

minimumPartSizeInBytes

public Long minimumPartSizeInBytes()

targetThroughputInGbps

public Double targetThroughputInGbps()

maxConcurrency

public Integer maxConcurrency()

endpointOverride

public URI endpointOverride()

readBufferSizeInBytes

public Long readBufferSizeInBytes()

credentialsProvider

public S3CrtAsyncClientBuilder credentialsProvider(AwsCredentialsProvider credentialsProvider)

Description copied from interface: S3CrtAsyncClientBuilder

Configure the credentials that should be used to authenticate with S3.

The default provider will attempt to identify the credentials automatically using the following checks:

1. Java System Properties - aws.accessKeyId and aws.secretKey
2. Environment Variables - AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY
3. Credential profiles file at the default location (~/.aws/credentials) shared by all AWS SDKs and the AWS CLI
4. Credentials delivered through the Amazon EC2 container service if AWS_CONTAINER_CREDENTIALS_RELATIVE_URI environment variable is set and security manager has permission to access the variable.
5. Instance profile credentials delivered through the Amazon EC2 metadata service

If the credentials are not found in any of the locations above, an exception will be thrown at S3CrtAsyncClientBuilder.build() time.

Specified by:

credentialsProvider in interface S3CrtAsyncClientBuilder

Parameters:

credentialsProvider - the credentials to use

Returns:

This builder for method chaining.

region

public S3CrtAsyncClientBuilder region(Region region)

Description copied from interface: S3CrtAsyncClientBuilder

Configure the region with which the SDK should communicate.

If this is not specified, the SDK will attempt to identify the endpoint automatically using the following logic:

1. Check the 'aws.region' system property for the region.
2. Check the 'AWS_REGION' environment variable for the region.
3. Check the {user.home}/.aws/credentials and {user.home}/.aws/config files for the region.
4. If running in EC2, check the EC2 metadata service for the region.

Specified by:

region in interface S3CrtAsyncClientBuilder

Parameters:

region - the region to be used

Returns:

this builder for method chaining.

minimumPartSizeInBytes

public S3CrtAsyncClientBuilder minimumPartSizeInBytes(Long partSizeBytes)

Description copied from interface: S3CrtAsyncClientBuilder

Sets the minimum part size for transfer parts. Decreasing the minimum part size causes multipart transfer to be split into a larger number of smaller parts. Setting this value too low has a negative effect on transfer speeds, causing extra latency and network communication for each part.

By default, it is 8MB. See Amazon S3 multipart upload limits for guidance.

Specified by:

minimumPartSizeInBytes in interface S3CrtAsyncClientBuilder

Parameters:

partSizeBytes - The minimum part size for transfer parts.

Returns:

this builder for method chaining.

targetThroughputInGbps

public S3CrtAsyncClientBuilder targetThroughputInGbps(Double targetThroughputInGbps)

Description copied from interface: S3CrtAsyncClientBuilder

The target throughput for transfer requests. Higher value means more connections will be established with S3.

Whether the transfer manager can achieve the configured target throughput depends on various factors such as the network bandwidth of the environment and whether S3CrtAsyncClientBuilder.maxConcurrency(java.lang.Integer) is configured.

By default, it is 10 gigabits per second. If users want to transfer as fast as possible, it's recommended to set it to the maximum network bandwidth on the host that the application is running on. For EC2 instances, you can find network bandwidth for a specific instance type in Amazon EC2 instance type page. If you are running into out of file descriptors error, consider using S3CrtAsyncClientBuilder.maxConcurrency(Integer) to limit the number of connections.

Specified by:

targetThroughputInGbps in interface S3CrtAsyncClientBuilder

Parameters:

targetThroughputInGbps - the target throughput in Gbps

Returns:

this builder for method chaining.

See Also:

S3CrtAsyncClientBuilder.maxConcurrency(Integer)

maxConcurrency

public S3CrtAsyncClientBuilder maxConcurrency(Integer maxConcurrency)

Description copied from interface: S3CrtAsyncClientBuilder

Specifies the maximum number of S3 connections that should be established during a transfer.

If not provided, the TransferManager will calculate the optional number of connections based on S3CrtAsyncClientBuilder.targetThroughputInGbps(java.lang.Double). If the value is too low, the S3TransferManager might not achieve the specified target throughput.

Specified by:

maxConcurrency in interface S3CrtAsyncClientBuilder

Parameters:

maxConcurrency - the max number of concurrent requests

Returns:

this builder for method chaining.

See Also:

S3CrtAsyncClientBuilder.targetThroughputInGbps(Double)

endpointOverride

public S3CrtAsyncClientBuilder endpointOverride(URI endpointOverride)

Description copied from interface: S3CrtAsyncClientBuilder

Configure the endpoint override with which the SDK should communicate.

Specified by:

endpointOverride in interface S3CrtAsyncClientBuilder

Parameters:

endpointOverride - the endpoint override to be used

Returns:

this builder for method chaining.

checksumValidationEnabled

public S3CrtAsyncClientBuilder checksumValidationEnabled(Boolean checksumValidationEnabled)

Description copied from interface: S3CrtAsyncClientBuilder

Option to disable checksum validation for S3AsyncClient.getObject(GetObjectRequest, Path) and S3AsyncClient.putObject(PutObjectRequest, Path).

Checksum validation using CRC32 is enabled by default.

Specified by:

checksumValidationEnabled in interface S3CrtAsyncClientBuilder

initialReadBufferSizeInBytes

public S3CrtAsyncClientBuilder initialReadBufferSizeInBytes(Long readBufferSizeInBytes)

Description copied from interface: S3CrtAsyncClientBuilder

Configure the starting buffer size the client will use to buffer the parts downloaded from S3. Maintain a larger window to keep up a high download throughput; parts cannot download in parallel unless the window is large enough to hold multiple parts. Maintain a smaller window to limit the amount of data buffered in memory.

By default, it is equal to the resolved part size * 10

Specified by:

initialReadBufferSizeInBytes in interface S3CrtAsyncClientBuilder

Parameters:

readBufferSizeInBytes - the initial read buffer size

Returns:

this builder for method chaining.

httpConfiguration

public S3CrtAsyncClientBuilder httpConfiguration(S3CrtHttpConfiguration configuration)

Description copied from interface: S3CrtAsyncClientBuilder

Sets the HTTP configuration to use for this client.

Specified by:

httpConfiguration in interface S3CrtAsyncClientBuilder

Parameters:

configuration - The http proxy configuration to use

Returns:

The builder of the method chaining.

build

public S3CrtAsyncClient build()

Specified by:

build in interface S3CrtAsyncClientBuilder

Specified by:

build in interface Buildable

Specified by:

build in interface SdkBuilder<S3CrtAsyncClientBuilder,S3AsyncClient>