org.gridgain.grid.kernal.processors.hadoop.jobtracker

Class GridHadoopJobTracker

java.lang.Object

org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

org.gridgain.grid.kernal.processors.hadoop.jobtracker.GridHadoopJobTracker

public class GridHadoopJobTracker
extends GridHadoopComponent

Hadoop job tracker.

Field Summary

Fields inherited from class org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

ctx, log

Constructor Summary

Constructors

Constructor and Description
GridHadoopJobTracker()

Method Summary

Methods

Modifier and Type	Method and Description
org.gridgain.grid.GridFuture<?>	finishFuture(org.gridgain.grid.hadoop.GridHadoopJobId jobId) Gets job finish future.
org.gridgain.grid.hadoop.GridHadoopJob	job(org.gridgain.grid.hadoop.GridHadoopJobId jobId, org.gridgain.grid.hadoop.GridHadoopJobInfo jobInfo) Gets or creates job instance.
boolean	killJob(org.gridgain.grid.hadoop.GridHadoopJobId jobId) Kills job.
void	onExternalMappersInitialized(org.gridgain.grid.hadoop.GridHadoopJobId jobId, Collection<Integer> reducers, GridHadoopProcessDescriptor desc) Callback from task executor called when process is ready to received shuffle messages.
void	onKernalStart() Callback invoked when all grid components are started.
void	onKernalStop(boolean cancel) Callback invoked before all grid components are stopped.
void	onTaskFinished(org.gridgain.grid.hadoop.GridHadoopTaskInfo info, GridHadoopTaskStatus status) Callback from task executor invoked when a task has been finished.
org.gridgain.grid.hadoop.GridHadoopMapReducePlan	plan(org.gridgain.grid.hadoop.GridHadoopJobId jobId) Gets job plan by job ID.
void	start(GridHadoopContext ctx)
org.gridgain.grid.hadoop.GridHadoopJobStatus	status(org.gridgain.grid.hadoop.GridHadoopJobId jobId) Gets hadoop job status for given job ID.
org.gridgain.grid.GridFuture<org.gridgain.grid.hadoop.GridHadoopJobId>	submit(org.gridgain.grid.hadoop.GridHadoopJobId jobId, org.gridgain.grid.hadoop.GridHadoopJobInfo info) Submits execution of Hadoop job to grid.

Methods inherited from class org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridHadoopJobTracker

public GridHadoopJobTracker()

Method Detail

start

public void start(GridHadoopContext ctx)
           throws org.gridgain.grid.GridException

Overrides:

start in class GridHadoopComponent

Parameters:

ctx - Hadoop context.

Throws:

org.gridgain.grid.GridException

onKernalStart

public void onKernalStart()
                   throws org.gridgain.grid.GridException

Callback invoked when all grid components are started.

Overrides:

onKernalStart in class GridHadoopComponent

Throws:

org.gridgain.grid.GridException

onKernalStop

public void onKernalStop(boolean cancel)

Callback invoked before all grid components are stopped.

Overrides:

onKernalStop in class GridHadoopComponent

submit

public org.gridgain.grid.GridFuture<org.gridgain.grid.hadoop.GridHadoopJobId> submit(org.gridgain.grid.hadoop.GridHadoopJobId jobId,
                                                                            org.gridgain.grid.hadoop.GridHadoopJobInfo info)

Submits execution of Hadoop job to grid.

Parameters:

jobId - Job ID.

info - Job info.

Returns:

Job completion future.

status

@Nullable
public org.gridgain.grid.hadoop.GridHadoopJobStatus status(org.gridgain.grid.hadoop.GridHadoopJobId jobId)
                                                    throws org.gridgain.grid.GridException

Gets hadoop job status for given job ID.

Parameters:

jobId - Job ID to get status for.

Returns:

Job status for given job ID or null if job was not found.

Throws:

org.gridgain.grid.GridException

finishFuture

@Nullable
public org.gridgain.grid.GridFuture<?> finishFuture(org.gridgain.grid.hadoop.GridHadoopJobId jobId)
                                             throws org.gridgain.grid.GridException

Gets job finish future.

Parameters:

jobId - Job ID.

Returns:

Finish future or null.

Throws:

org.gridgain.grid.GridException - If failed.

plan

public org.gridgain.grid.hadoop.GridHadoopMapReducePlan plan(org.gridgain.grid.hadoop.GridHadoopJobId jobId)
                                                      throws org.gridgain.grid.GridException

Gets job plan by job ID.

Parameters:

jobId - Job ID.

Returns:

Job plan.

Throws:

org.gridgain.grid.GridException - If failed.

onTaskFinished

public void onTaskFinished(org.gridgain.grid.hadoop.GridHadoopTaskInfo info,
                  GridHadoopTaskStatus status)

Callback from task executor invoked when a task has been finished.

Parameters:

info - Task info.

status - Task status.

onExternalMappersInitialized

public void onExternalMappersInitialized(org.gridgain.grid.hadoop.GridHadoopJobId jobId,
                                Collection<Integer> reducers,
                                GridHadoopProcessDescriptor desc)

Callback from task executor called when process is ready to received shuffle messages.

Parameters:

jobId - Job ID.

reducers - Reducers.

desc - Process descriptor.

job

@Nullable
public org.gridgain.grid.hadoop.GridHadoopJob job(org.gridgain.grid.hadoop.GridHadoopJobId jobId,
                                                  @Nullable
                                                  org.gridgain.grid.hadoop.GridHadoopJobInfo jobInfo)
                                           throws org.gridgain.grid.GridException

Gets or creates job instance.

Parameters:

jobId - Job ID.

jobInfo - Job info.

Returns:

Job.

Throws:

org.gridgain.grid.GridException - If failed.

killJob

public boolean killJob(org.gridgain.grid.hadoop.GridHadoopJobId jobId)
                throws org.gridgain.grid.GridException

Kills job.

Parameters:

jobId - Job ID.

Returns:

True if job was killed.

Throws:

org.gridgain.grid.GridException - If failed.