Uses of Class
org.apache.hadoop.fs.s3a.commit.impl.CommitContext

Packages that use CommitContext

Package	Description
org.apache.hadoop.fs.s3a.commit	Support for committing the output of analytics jobs directly to S3.
org.apache.hadoop.fs.s3a.commit.impl	Internal classes which make use of mapreduce code.
org.apache.hadoop.fs.s3a.commit.magic	This is the "Magic" committer and support.
org.apache.hadoop.fs.s3a.commit.staging	The staging committers.

Uses of CommitContext in org.apache.hadoop.fs.s3a.commit

Methods in org.apache.hadoop.fs.s3a.commit that return CommitContext

Modifier and Type	Method and Description
protected CommitContext	AbstractS3ACommitter.initiateJobOperation(org.apache.hadoop.mapreduce.JobContext context) Start the final job commit/abort commit operations.
protected CommitContext	AbstractS3ACommitter.initiateTaskOperation(org.apache.hadoop.mapreduce.JobContext context) Start a ask commit/abort commit operations.

Methods in org.apache.hadoop.fs.s3a.commit with parameters of type CommitContext

Modifier and Type	Method and Description
protected void	AbstractS3ACommitter.abortJobInternal(CommitContext commitContext, boolean suppressExceptions) The internal job abort operation; can be overridden in tests.
protected void	AbstractS3ACommitter.abortPendingUploads(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending, boolean suppressExceptions, boolean deleteRemoteFiles) Abort all pending uploads in the list.
protected void	AbstractS3ACommitter.abortPendingUploads(CommitContext commitContext, List<SinglePendingCommit> pending, boolean suppressExceptions) Abort all pending uploads in the list.
protected void	AbstractS3ACommitter.abortPendingUploadsInCleanup(boolean suppressExceptions, CommitContext commitContext) Abort all pending uploads to the destination directory during job cleanup operations.
protected void	AbstractS3ACommitter.cleanup(CommitContext commitContext, boolean suppressExceptions) Cleanup the job context, including aborting anything pending and destroying the thread pool.
protected void	AbstractS3ACommitter.commitJobInternal(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Internal Job commit operation: where the S3 requests are made (potentially in parallel).
protected void	AbstractS3ACommitter.commitPendingUploads(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Commit all the pending uploads.
protected abstract AbstractS3ACommitter.ActiveCommit	AbstractS3ACommitter.listPendingUploadsToCommit(CommitContext commitContext) Get the list of pending uploads for this job attempt.
protected SuccessData	AbstractS3ACommitter.maybeCreateSuccessMarkerFromCommits(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) if the job requires a success marker on a successful job, create the file CommitConstants._SUCCESS.
protected void	AbstractS3ACommitter.precommitCheckPendingFiles(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Run a precommit check that all files are loadable.
void	AbstractS3ACommitter.preCommitJob(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Subclass-specific pre-Job-commit actions.

Uses of CommitContext in org.apache.hadoop.fs.s3a.commit.impl

Methods in org.apache.hadoop.fs.s3a.commit.impl that return CommitContext

Modifier and Type	Method and Description
CommitContext	CommitOperations.createCommitContext(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path path, int committerThreads, org.apache.hadoop.fs.statistics.IOStatisticsContext ioStatisticsContext) Create a commit context for a job or task.
CommitContext	CommitOperations.createCommitContextForTesting(org.apache.hadoop.fs.Path path, String jobId, int committerThreads) Create a stub commit context for tests.

Methods in org.apache.hadoop.fs.s3a.commit.impl with parameters of type CommitContext

Modifier and Type	Method and Description
CommitOperations.MaybeIOE	CommitOperations.abortAllSinglePendingCommits(org.apache.hadoop.fs.Path pendingDir, CommitContext commitContext, boolean recursive) Enumerate all pending files in a dir/tree, abort.
org.apache.commons.lang3.tuple.Pair<PendingSet,List<org.apache.commons.lang3.tuple.Pair<org.apache.hadoop.fs.LocatedFileStatus,IOException>>>	CommitOperations.loadSinglePendingCommits(org.apache.hadoop.fs.Path pendingDir, boolean recursive, CommitContext commitContext) Load all single pending commits in the directory, using the outer submitter.

Uses of CommitContext in org.apache.hadoop.fs.s3a.commit.magic

Methods in org.apache.hadoop.fs.s3a.commit.magic with parameters of type CommitContext

Modifier and Type	Method and Description
protected AbstractS3ACommitter.ActiveCommit	MagicS3GuardCommitter.listPendingUploadsToCommit(CommitContext commitContext) Get the list of pending uploads for this job attempt, by listing all .pendingset files in the job attempt directory.

Uses of CommitContext in org.apache.hadoop.fs.s3a.commit.staging

Methods in org.apache.hadoop.fs.s3a.commit.staging with parameters of type CommitContext

Modifier and Type	Method and Description
protected void	StagingCommitter.abortJobInternal(CommitContext commitContext, boolean suppressExceptions)
protected void	StagingCommitter.cleanup(CommitContext commitContext, boolean suppressExceptions) Staging committer cleanup includes calling wrapped committer's cleanup method, and removing staging uploads path and all destination paths in the final filesystem.
protected int	StagingCommitter.commitTaskInternal(org.apache.hadoop.mapreduce.TaskAttemptContext context, List<? extends org.apache.hadoop.fs.FileStatus> taskOutput, CommitContext commitContext) Commit the task by uploading all created files and then writing a pending entry for them.
protected int	PartitionedStagingCommitter.commitTaskInternal(org.apache.hadoop.mapreduce.TaskAttemptContext context, List<? extends org.apache.hadoop.fs.FileStatus> taskOutput, CommitContext commitContext)
protected AbstractS3ACommitter.ActiveCommit	StagingCommitter.listPendingUploads(CommitContext commitContext, boolean suppressExceptions) Get the list of pending uploads for this job attempt.
protected AbstractS3ACommitter.ActiveCommit	StagingCommitter.listPendingUploadsToAbort(CommitContext commitContext) Get the list of pending uploads for this job attempt, swallowing exceptions.
protected AbstractS3ACommitter.ActiveCommit	StagingCommitter.listPendingUploadsToCommit(CommitContext commitContext) Get the list of pending uploads for this job attempt.
void	StagingCommitter.preCommitJob(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Pre-commit actions for a job.
void	PartitionedStagingCommitter.preCommitJob(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) All Job-side conflict resolution.
void	DirectoryStagingCommitter.preCommitJob(CommitContext commitContext, AbstractS3ACommitter.ActiveCommit pending) Pre-commit actions for a job.