org.apache.hadoop.fs.s3a

Class S3GuardExistsRetryPolicy

java.lang.Object

org.apache.hadoop.fs.s3a.S3ARetryPolicy

org.apache.hadoop.fs.s3a.S3GuardExistsRetryPolicy

All Implemented Interfaces:

org.apache.hadoop.io.retry.RetryPolicy

public class S3GuardExistsRetryPolicy
extends S3ARetryPolicy

Slightly-modified retry policy for cases when the file is present in the MetadataStore, but may be still throwing FileNotFoundException from S3.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.io.retry.RetryPolicy

org.apache.hadoop.io.retry.RetryPolicy.RetryAction

Field Summary

Fields inherited from class org.apache.hadoop.fs.s3a.S3ARetryPolicy

baseExponentialRetry, connectivityFailure, fail, retryIdempotentCalls, throttlePolicy

Constructor Summary

Constructors

Constructor and Description
S3GuardExistsRetryPolicy(org.apache.hadoop.conf.Configuration conf) Instantiate.

Method Summary

Modifier and Type	Method and Description
protected Map<Class<? extends Exception>,org.apache.hadoop.io.retry.RetryPolicy>	createExceptionMap() Subclasses can override this like a constructor to change behavior: call superclass method, then modify it as needed, and return it.

Methods inherited from class org.apache.hadoop.fs.s3a.S3ARetryPolicy

createThrottleRetryPolicy, getConfiguration, shouldRetry

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3GuardExistsRetryPolicy

public S3GuardExistsRetryPolicy(org.apache.hadoop.conf.Configuration conf)

Instantiate.

Parameters:

conf - configuration to read.

Method Detail

createExceptionMap

protected Map<Class<? extends Exception>,org.apache.hadoop.io.retry.RetryPolicy> createExceptionMap()

Description copied from class: S3ARetryPolicy

Subclasses can override this like a constructor to change behavior: call superclass method, then modify it as needed, and return it.

Overrides:

createExceptionMap in class S3ARetryPolicy

Returns:

Map from exception type to RetryPolicy