org.apache.hadoop.fs.s3a.impl

Class NetworkBinding

java.lang.Object

org.apache.hadoop.fs.s3a.impl.NetworkBinding

public final class NetworkBinding
extends Object

Configures network settings when communicating with AWS services.

Method Summary

Modifier and Type	Method and Description
static void	bindSSLChannelMode(org.apache.hadoop.conf.Configuration conf, com.amazonaws.ClientConfiguration awsConf) Configures the SSLConnectionSocketFactory used by the AWS SDK.
static String	fixBucketRegion(String region) Given an S3 bucket region as returned by a bucket location query, fix it into a form which can be used by other AWS commands.
static void	logDnsLookup(org.apache.hadoop.conf.Configuration conf) Log the dns address associated with s3 endpoint.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

bindSSLChannelMode

public static void bindSSLChannelMode(org.apache.hadoop.conf.Configuration conf,
                                      com.amazonaws.ClientConfiguration awsConf)
                               throws IOException

Configures the SSLConnectionSocketFactory used by the AWS SDK. A custom Socket Factory can be set using the method setSslSocketFactory(). Uses reflection to do this via ConfigureShadedAWSSocketFactory so as to avoid

Parameters:

conf - the Configuration used to get the client specified value of SSL_CHANNEL_MODE

awsConf - the ClientConfiguration to set the SSLConnectionSocketFactory for.

Throws:

IOException - if there is an error while initializing the SSLSocketFactory other than classloader problems.

fixBucketRegion

public static String fixBucketRegion(String region)

Given an S3 bucket region as returned by a bucket location query, fix it into a form which can be used by other AWS commands.

https://forums.aws.amazon.com/thread.jspa?messageID=796829

See also com.amazonaws.services.s3.model.Region.fromValue() for its conversion logic.

Parameters:

region - region from S3 call.

Returns:

the region to use in DDB etc.

logDnsLookup

public static void logDnsLookup(org.apache.hadoop.conf.Configuration conf)

Log the dns address associated with s3 endpoint. If endpoint is not set in the configuration, the Constants#DEFAULT_ENDPOINT will be used.

Parameters:

conf - input configuration.