org.apache.hadoop.fs.s3a

Interface WriteOperationHelper.WriteOperationHelperCallbacks

Enclosing class:

WriteOperationHelper

public static interface WriteOperationHelper.WriteOperationHelperCallbacks

Callbacks for writeOperationHelper.

Method Summary

Modifier and Type	Method and Description
software.amazon.awssdk.services.s3.model.CompleteMultipartUploadResponse	completeMultipartUpload(software.amazon.awssdk.services.s3.model.CompleteMultipartUploadRequest request) Initiates a complete multi-part upload request.
void	finishedWrite(String key, long length, PutObjectOptions putOptions) Perform post-write actions.
software.amazon.awssdk.services.s3.model.UploadPartResponse	uploadPart(software.amazon.awssdk.services.s3.model.UploadPartRequest request, software.amazon.awssdk.core.sync.RequestBody body, org.apache.hadoop.fs.statistics.DurationTrackerFactory durationTrackerFactory) Upload part of a multi-partition file.

Method Detail

completeMultipartUpload

@Retries.OnceRaw
software.amazon.awssdk.services.s3.model.CompleteMultipartUploadResponse completeMultipartUpload(software.amazon.awssdk.services.s3.model.CompleteMultipartUploadRequest request)

Initiates a complete multi-part upload request.

Parameters:

request - Complete multi-part upload request

Returns:

completeMultipartUploadResult

uploadPart

@Retries.OnceRaw
software.amazon.awssdk.services.s3.model.UploadPartResponse uploadPart(software.amazon.awssdk.services.s3.model.UploadPartRequest request,
                                                                                        software.amazon.awssdk.core.sync.RequestBody body,
                                                                                        org.apache.hadoop.fs.statistics.DurationTrackerFactory durationTrackerFactory)
                                                                                 throws software.amazon.awssdk.awscore.exception.AwsServiceException,
                                                                                        UncheckedIOException

Upload part of a multi-partition file. Increments the write and put counters. Important: this call does not close any input stream in the body.

Retry Policy: none.

Parameters:

durationTrackerFactory - duration tracker factory for operation

request - the upload part request.

body - the request body.

Returns:

the result of the operation.

Throws:

software.amazon.awssdk.awscore.exception.AwsServiceException - on problems

UncheckedIOException - failure to instantiate the s3 client

finishedWrite

@Retries.RetryExceptionsSwallowed
void finishedWrite(String key,
                                                     long length,
                                                     PutObjectOptions putOptions)

Perform post-write actions.

This operation MUST be called after any PUT/multipart PUT completes successfully.

Parameters:

key - key written to

length - total length of file written

putOptions - put object options