org.gridgain.grid.kernal.processors.hadoop.v2

Class GridHadoopV2Task

java.lang.Object

org.gridgain.grid.hadoop.GridHadoopTask

org.gridgain.grid.kernal.processors.hadoop.v2.GridHadoopV2Task

Direct Known Subclasses:

GridHadoopV2CleanupTask, GridHadoopV2MapTask, GridHadoopV2ReduceTask, GridHadoopV2SetupTask

public abstract class GridHadoopV2Task
extends org.gridgain.grid.hadoop.GridHadoopTask

Extended Hadoop v2 task.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	GridHadoopV2Task(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	abort(org.apache.hadoop.mapreduce.OutputFormat outputFormat) Abort task.
void	cancel()
protected void	closeWriter() Close writer.
protected void	commit(org.apache.hadoop.mapreduce.OutputFormat outputFormat) Commit task.
protected org.apache.hadoop.mapreduce.OutputFormat	getOutputFormat(org.apache.hadoop.mapreduce.JobContext jobCtx) Create and configure an OutputFormat instance.
protected GridHadoopV2Context	hadoopContext()
protected org.apache.hadoop.mapreduce.OutputFormat	prepareWriter(org.apache.hadoop.mapreduce.JobContext jobCtx) Put write into Hadoop context and return associated output format instance.
void	run(org.gridgain.grid.hadoop.GridHadoopTaskContext taskCtx)
protected abstract void	run0(GridHadoopV2Job job, org.apache.hadoop.mapreduce.JobContext jobCtx, org.gridgain.grid.hadoop.GridHadoopTaskContext taskCtx) Internal task routine.
protected void	setup(org.apache.hadoop.mapreduce.OutputFormat outputFormat) Setup task.

Methods inherited from class org.gridgain.grid.hadoop.GridHadoopTask

info

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridHadoopV2Task

protected GridHadoopV2Task(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo)

Constructor.

Parameters:

taskInfo - Task info.

Method Detail

run

public void run(org.gridgain.grid.hadoop.GridHadoopTaskContext taskCtx)
         throws org.gridgain.grid.GridException

Specified by:

run in class org.gridgain.grid.hadoop.GridHadoopTask

Throws:

org.gridgain.grid.GridException

run0

protected abstract void run0(GridHadoopV2Job job,
        org.apache.hadoop.mapreduce.JobContext jobCtx,
        org.gridgain.grid.hadoop.GridHadoopTaskContext taskCtx)
                      throws org.gridgain.grid.GridException

Internal task routine.

Parameters:

job - Job.

jobCtx - Job context.

taskCtx - Task context.

Throws:

org.gridgain.grid.GridException

hadoopContext

protected GridHadoopV2Context hadoopContext()

Returns:

hadoop context.

getOutputFormat

protected org.apache.hadoop.mapreduce.OutputFormat getOutputFormat(org.apache.hadoop.mapreduce.JobContext jobCtx)
                                                            throws ClassNotFoundException

Create and configure an OutputFormat instance.

Parameters:

jobCtx - Job context.

Returns:

Instance of OutputFormat is specified in job configuration.

Throws:

ClassNotFoundException - If specified class not found.

prepareWriter

protected org.apache.hadoop.mapreduce.OutputFormat prepareWriter(org.apache.hadoop.mapreduce.JobContext jobCtx)
                                                          throws org.gridgain.grid.GridException,
                                                                 InterruptedException

Put write into Hadoop context and return associated output format instance.

Parameters:

jobCtx - Job context.

Returns:

Output format.

Throws:

org.gridgain.grid.GridException - In case of Grid exception.

InterruptedException - In case of interrupt.

closeWriter

protected void closeWriter()
                    throws IOException,
                           InterruptedException

Close writer.

Throws:

IOException - In case of IO exception.

InterruptedException - In case of interrupt.

setup

protected void setup(@Nullable
         org.apache.hadoop.mapreduce.OutputFormat outputFormat)
              throws IOException,
                     InterruptedException

Setup task.

Parameters:

outputFormat - Output format.

Throws:

IOException - In case of IO exception.

InterruptedException - In case of interrupt.

commit

protected void commit(@Nullable
          org.apache.hadoop.mapreduce.OutputFormat outputFormat)
               throws org.gridgain.grid.GridException,
                      IOException,
                      InterruptedException

Commit task.

Parameters:

outputFormat - Output format.

Throws:

org.gridgain.grid.GridException - In case of Grid exception.

IOException - In case of IO exception.

InterruptedException - In case of interrupt.

abort

protected void abort(@Nullable
         org.apache.hadoop.mapreduce.OutputFormat outputFormat)

Abort task.

Parameters:

outputFormat - Output format.

cancel

public void cancel()

Specified by:

cancel in class org.gridgain.grid.hadoop.GridHadoopTask