org.apache.hadoop.fs.s3a.impl

Class NetworkBinding

java.lang.Object

org.apache.hadoop.fs.s3a.impl.NetworkBinding

public class NetworkBinding
extends Object

Configures network settings when communicating with AWS services.

Constructor Summary

Constructors

Constructor and Description
NetworkBinding()

Method Summary

Modifier and Type	Method and Description
static void	bindSSLChannelMode(org.apache.hadoop.conf.Configuration conf, com.amazonaws.ClientConfiguration awsConf) Configures the .SSLConnectionSocketFactory used by the AWS SDK.
static String	fixBucketRegion(String region) Given an S3 bucket region as returned by a bucket location query, fix it into a form which can be used by other AWS commands.
static void	logDnsLookup(org.apache.hadoop.conf.Configuration conf) Log the dns address associated with s3 endpoint.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NetworkBinding

public NetworkBinding()

Method Detail

bindSSLChannelMode

public static void bindSSLChannelMode(org.apache.hadoop.conf.Configuration conf,
                                      com.amazonaws.ClientConfiguration awsConf)
                               throws IOException

Configures the .SSLConnectionSocketFactory used by the AWS SDK. A custom SSLConnectionSocketFactory can be set using the method ApacheHttpClientConfig.setSslSocketFactory( com.amazonaws.thirdparty.apache.http.conn.socket.ConnectionSocketFactory). If .SSLConnectionSocketFactory cannot be found on the classpath, the value of Constants.SSL_CHANNEL_MODE is ignored.

Parameters:

conf - the Configuration used to get the client specified value of #SSL_CHANNEL_MODE

awsConf - the ClientConfiguration to set the SSLConnectionSocketFactory for.

Throws:

IOException - if there is an error while initializing the SSLSocketFactory other than classloader problems.

fixBucketRegion

public static String fixBucketRegion(String region)

Given an S3 bucket region as returned by a bucket location query, fix it into a form which can be used by other AWS commands.

https://forums.aws.amazon.com/thread.jspa?messageID=796829

See also com.amazonaws.services.s3.model.Region.fromValue() for its conversion logic.

Parameters:

region - region from S3 call.

Returns:

the region to use in DDB etc.

logDnsLookup

public static void logDnsLookup(org.apache.hadoop.conf.Configuration conf)

Log the dns address associated with s3 endpoint. If endpoint is not set in the configuration, the Constants#DEFAULT_ENDPOINT will be used.

Parameters:

conf - input configuration.