org.apache.hadoop.fs.azurebfs

Class AzureBlobFileSystem.ResilientCommitByRenameImpl

java.lang.Object

org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.ResilientCommitByRenameImpl

All Implemented Interfaces:

ResilientCommitByRename, org.apache.hadoop.fs.statistics.IOStatisticsSource

Enclosing class:

AzureBlobFileSystem

public class AzureBlobFileSystem.ResilientCommitByRenameImpl
extends Object
implements ResilientCommitByRename

Resilient commit support. Provided as a nested class to avoid contaminating the FS instance with too many private methods which end up being used widely (as has happened to the S3A FS)

Constructor Summary

Constructors

Constructor and Description
ResilientCommitByRenameImpl()

Method Summary

Modifier and Type	Method and Description
org.apache.commons.lang3.tuple.Pair<Boolean,Duration>	commitSingleFileByRename(org.apache.hadoop.fs.Path source, org.apache.hadoop.fs.Path dest, String sourceEtag) Perform the rename.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.fs.statistics.IOStatisticsSource

getIOStatistics

Constructor Detail

ResilientCommitByRenameImpl

public ResilientCommitByRenameImpl()

Method Detail

commitSingleFileByRename

public org.apache.commons.lang3.tuple.Pair<Boolean,Duration> commitSingleFileByRename(org.apache.hadoop.fs.Path source,
                                                                                      org.apache.hadoop.fs.Path dest,
                                                                                      @Nullable
                                                                                      String sourceEtag)
                                                                               throws IOException

Perform the rename. This will be rate limited, as well as able to recover from rename errors if the etag was passed in.

Specified by:

commitSingleFileByRename in interface ResilientCommitByRename

Parameters:

source - path to source file

dest - destination of rename.

sourceEtag - etag of source file. may be null or empty

Returns:

the outcome of the operation

Throws:

IOException - any rename failure which was not recovered from.