org.apache.hadoop.fs.s3a.tools

Class MarkerToolOperationsImpl

java.lang.Object

org.apache.hadoop.fs.s3a.tools.MarkerToolOperationsImpl

All Implemented Interfaces:

MarkerToolOperations

public class MarkerToolOperationsImpl
extends Object
implements MarkerToolOperations

Implement the marker tool operations by forwarding to the OperationCallbacks instance provided in the constructor.

Constructor Summary

Constructors

Constructor and Description
MarkerToolOperationsImpl(OperationCallbacks operations) Constructor.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.RemoteIterator<S3AFileStatus>	listObjects(org.apache.hadoop.fs.Path path, String key) Create an iterator over objects in S3.
void	removeKeys(List<software.amazon.awssdk.services.s3.model.ObjectIdentifier> keysToDelete, boolean deleteFakeDir) Remove keys from the store.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MarkerToolOperationsImpl

public MarkerToolOperationsImpl(OperationCallbacks operations)

Constructor.

Parameters:

operations - implementation of the operations

Method Detail

listObjects

public org.apache.hadoop.fs.RemoteIterator<S3AFileStatus> listObjects(org.apache.hadoop.fs.Path path,
                                                                      String key)
                                                               throws IOException

Description copied from interface: MarkerToolOperations

Create an iterator over objects in S3. The listing includes the key itself, if found.

Specified by:

listObjects in interface MarkerToolOperations

Parameters:

path - path of the listing.

key - object key

Returns:

iterator with the first listing completed.

Throws:

IOException - failure.

removeKeys

public void removeKeys(List<software.amazon.awssdk.services.s3.model.ObjectIdentifier> keysToDelete,
                       boolean deleteFakeDir)
                throws MultiObjectDeleteException,
                       software.amazon.awssdk.awscore.exception.AwsServiceException,
                       IOException

Description copied from interface: MarkerToolOperations

Remove keys from the store.

Specified by:

removeKeys in interface MarkerToolOperations

Parameters:

keysToDelete - collection of keys to delete on the s3-backend. if empty, no request is made of the object store.

deleteFakeDir - indicates whether this is for deleting fake dirs. all deleted keys

Throws:

MultiObjectDeleteException - one or more of the keys could not be deleted in a multiple object delete operation.

software.amazon.awssdk.awscore.exception.AwsServiceException - amazon-layer failure.

org.apache.hadoop.fs.InvalidRequestException - if the request was rejected due to a mistaken attempt to delete the root directory.

IOException - other IO Exception.