Uses of Class
org.apache.hadoop.fs.s3a.commit.files.SinglePendingCommit

Packages that use SinglePendingCommit

Package	Description
org.apache.hadoop.fs.s3a.commit	Support for committing the output of analytics jobs directly to S3.
org.apache.hadoop.fs.s3a.commit.files	Persistent data formats for the committers.
org.apache.hadoop.fs.s3a.commit.magic	This is the "Magic" committer and support.
org.apache.hadoop.fs.s3a.commit.staging	The staging committers.

Uses of SinglePendingCommit in org.apache.hadoop.fs.s3a.commit

Methods in org.apache.hadoop.fs.s3a.commit that return SinglePendingCommit

Modifier and Type	Method and Description
SinglePendingCommit	CommitOperations.uploadFileToPendingCommit(File localFile, org.apache.hadoop.fs.Path destPath, String partition, long uploadPartSize) Upload all the data in the local file, returning the information needed to commit the work.

Methods in org.apache.hadoop.fs.s3a.commit that return types with arguments of type SinglePendingCommit

Modifier and Type	Method and Description
protected abstract List<SinglePendingCommit>	AbstractS3ACommitter.listPendingUploadsToCommit(org.apache.hadoop.mapreduce.JobContext context) Get the list of pending uploads for this job attempt.
protected List<SinglePendingCommit>	AbstractS3ACommitter.loadPendingsetFiles(org.apache.hadoop.mapreduce.JobContext context, boolean suppressExceptions, org.apache.hadoop.fs.FileSystem fs, Iterable<? extends org.apache.hadoop.fs.FileStatus> pendingCommitFiles) Try to read every pendingset file and build a list of them/ In the case of a failure to read the file, exceptions are held until all reads have been attempted.

Methods in org.apache.hadoop.fs.s3a.commit with parameters of type SinglePendingCommit

Modifier and Type	Method and Description
void	CommitOperations.abortSingleCommit(SinglePendingCommit commit) Abort the multipart commit supplied.
CommitOperations.MaybeIOE	CommitOperations.commit(SinglePendingCommit commit, String origin) Commit a single pending commit; exceptions are caught and converted to an outcome.
void	CommitOperations.commitOrFail(SinglePendingCommit commit) Commit the operation, throwing an exception on any failure.
void	CommitOperations.revertCommit(SinglePendingCommit commit) Revert a pending commit by deleting the destination.

Method parameters in org.apache.hadoop.fs.s3a.commit with type arguments of type SinglePendingCommit

Modifier and Type	Method and Description
protected void	AbstractS3ACommitter.abortPendingUploads(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending, boolean suppressExceptions) Abort all pending uploads in the list.
protected void	AbstractS3ACommitter.commitJobInternal(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) Internal Job commit operation: where the S3 requests are made (potentially in parallel).
protected void	AbstractS3ACommitter.commitPendingUploads(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) Commit a list of pending uploads.
protected void	AbstractS3ACommitter.maybeCreateSuccessMarkerFromCommits(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) if the job requires a success marker on a successful job, create the file CommitConstants._SUCCESS.
protected void	AbstractS3ACommitter.preCommitJob(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) Subclass-specific pre commit actions.

Uses of SinglePendingCommit in org.apache.hadoop.fs.s3a.commit.files

Methods in org.apache.hadoop.fs.s3a.commit.files that return SinglePendingCommit

Modifier and Type	Method and Description
static SinglePendingCommit	SinglePendingCommit.load(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) Load an instance from a file, then validate it.

Methods in org.apache.hadoop.fs.s3a.commit.files that return types with arguments of type SinglePendingCommit

Modifier and Type	Method and Description
List<SinglePendingCommit>	PendingSet.getCommits()
static org.apache.hadoop.util.JsonSerialization<SinglePendingCommit>	SinglePendingCommit.serializer() Get a JSON serializer for this class.

Methods in org.apache.hadoop.fs.s3a.commit.files with parameters of type SinglePendingCommit

Modifier and Type	Method and Description
void	PendingSet.add(SinglePendingCommit commit) Add a commit.

Method parameters in org.apache.hadoop.fs.s3a.commit.files with type arguments of type SinglePendingCommit

Modifier and Type	Method and Description
void	PendingSet.setCommits(List<SinglePendingCommit> commits)

Uses of SinglePendingCommit in org.apache.hadoop.fs.s3a.commit.magic

Methods in org.apache.hadoop.fs.s3a.commit.magic that return types with arguments of type SinglePendingCommit

Modifier and Type	Method and Description
protected List<SinglePendingCommit>	MagicS3GuardCommitter.listPendingUploadsToCommit(org.apache.hadoop.mapreduce.JobContext context) Get the list of pending uploads for this job attempt, by listing all .pendingset files in the job attempt directory.

Uses of SinglePendingCommit in org.apache.hadoop.fs.s3a.commit.staging

Methods in org.apache.hadoop.fs.s3a.commit.staging that return types with arguments of type SinglePendingCommit

Modifier and Type	Method and Description
protected List<SinglePendingCommit>	StagingCommitter.listPendingUploads(org.apache.hadoop.mapreduce.JobContext context, boolean suppressExceptions) Get the list of pending uploads for this job attempt.
protected List<SinglePendingCommit>	StagingCommitter.listPendingUploadsToAbort(org.apache.hadoop.mapreduce.JobContext context) Get the list of pending uploads for this job attempt, swallowing exceptions.
protected List<SinglePendingCommit>	StagingCommitter.listPendingUploadsToCommit(org.apache.hadoop.mapreduce.JobContext context) Get the list of pending uploads for this job attempt.

Method parameters in org.apache.hadoop.fs.s3a.commit.staging with type arguments of type SinglePendingCommit

Modifier and Type	Method and Description
protected void	PartitionedStagingCommitter.preCommitJob(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) Job-side conflict resolution.
protected void	DirectoryStagingCommitter.preCommitJob(org.apache.hadoop.mapreduce.JobContext context, List<SinglePendingCommit> pending) Pre-commit actions for a job.