org.apache.hadoop.fs.s3a

Class S3AMultipartUploader

java.lang.Object

org.apache.hadoop.fs.MultipartUploader

org.apache.hadoop.fs.s3a.S3AMultipartUploader

All Implemented Interfaces:

Closeable, AutoCloseable

@InterfaceAudience.Private
 @InterfaceStability.Unstable
public class S3AMultipartUploader
extends org.apache.hadoop.fs.MultipartUploader

MultipartUploader for S3AFileSystem. This uses the S3 multipart upload mechanism.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	S3AMultipartUploader.Factory Factory for creating MultipartUploader objects for s3a:// FileSystems.

Field Summary

Fields

Modifier and Type	Field and Description
static String	HEADER Header for Parts: "S3A-part01".

Fields inherited from class org.apache.hadoop.fs.MultipartUploader

LOG

Constructor Summary

Constructors

Constructor and Description
S3AMultipartUploader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
void	abort(org.apache.hadoop.fs.Path filePath, org.apache.hadoop.fs.UploadHandle uploadId)
org.apache.hadoop.fs.PathHandle	complete(org.apache.hadoop.fs.Path filePath, Map<Integer,org.apache.hadoop.fs.PartHandle> handleMap, org.apache.hadoop.fs.UploadHandle uploadId)
org.apache.hadoop.fs.UploadHandle	initialize(org.apache.hadoop.fs.Path filePath)
org.apache.hadoop.fs.PartHandle	putPart(org.apache.hadoop.fs.Path filePath, InputStream inputStream, int partNumber, org.apache.hadoop.fs.UploadHandle uploadId, long lengthInBytes)

Methods inherited from class org.apache.hadoop.fs.MultipartUploader

checkPartHandles, checkPutArguments, checkUploadId, close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HEADER

public static final String HEADER

Header for Parts: "S3A-part01".

See Also:

Constant Field Values

Constructor Detail

S3AMultipartUploader

public S3AMultipartUploader(org.apache.hadoop.fs.FileSystem fs,
                            org.apache.hadoop.conf.Configuration conf)

Method Detail

initialize

public org.apache.hadoop.fs.UploadHandle initialize(org.apache.hadoop.fs.Path filePath)
                                             throws IOException

Specified by:

initialize in class org.apache.hadoop.fs.MultipartUploader

Throws:

IOException

putPart

public org.apache.hadoop.fs.PartHandle putPart(org.apache.hadoop.fs.Path filePath,
                                               InputStream inputStream,
                                               int partNumber,
                                               org.apache.hadoop.fs.UploadHandle uploadId,
                                               long lengthInBytes)
                                        throws IOException

Specified by:

putPart in class org.apache.hadoop.fs.MultipartUploader

Throws:

IOException

complete

public org.apache.hadoop.fs.PathHandle complete(org.apache.hadoop.fs.Path filePath,
                                                Map<Integer,org.apache.hadoop.fs.PartHandle> handleMap,
                                                org.apache.hadoop.fs.UploadHandle uploadId)
                                         throws IOException

Specified by:

complete in class org.apache.hadoop.fs.MultipartUploader

Throws:

IOException

abort

public void abort(org.apache.hadoop.fs.Path filePath,
                  org.apache.hadoop.fs.UploadHandle uploadId)
           throws IOException

Specified by:

abort in class org.apache.hadoop.fs.MultipartUploader

Throws:

IOException