org.gridgain.grid.kernal.processors.hadoop.shuffle

Class GridHadoopShuffle

java.lang.Object

org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

org.gridgain.grid.kernal.processors.hadoop.shuffle.GridHadoopShuffle

public class GridHadoopShuffle
extends GridHadoopComponent

Shuffle.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory	mem

Fields inherited from class org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

ctx, log

Constructor Summary

Constructors

Constructor and Description
GridHadoopShuffle()

Method Summary

Methods

Modifier and Type	Method and Description
org.gridgain.grid.GridFuture<?>	flush(org.gridgain.grid.hadoop.GridHadoopJobId jobId) Flushes all the outputs for the given job to remote nodes.
org.gridgain.grid.hadoop.GridHadoopTaskInput	input(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo)
void	jobFinished(org.gridgain.grid.hadoop.GridHadoopJobId jobId)
org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory	memory()
boolean	onMessageReceived(UUID src, GridHadoopMessage msg) Message received callback.
org.gridgain.grid.hadoop.GridHadoopTaskOutput	output(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo)
void	start(GridHadoopContext ctx)
void	stop(boolean cancel) Stops shuffle.

Methods inherited from class org.gridgain.grid.kernal.processors.hadoop.GridHadoopComponent

onKernalStart, onKernalStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mem

protected org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory mem

Constructor Detail

GridHadoopShuffle

public GridHadoopShuffle()

Method Detail

start

public void start(GridHadoopContext ctx)
           throws org.gridgain.grid.GridException

Overrides:

start in class GridHadoopComponent

Parameters:

ctx - Hadoop context.

Throws:

org.gridgain.grid.GridException

stop

public void stop(boolean cancel)

Stops shuffle.

Overrides:

stop in class GridHadoopComponent

Parameters:

cancel - If should cancel all ongoing activities.

onMessageReceived

public boolean onMessageReceived(UUID src,
                        GridHadoopMessage msg)

Message received callback.

Parameters:

src - Sender node ID.

msg - Received message.

Returns:

True.

output

public org.gridgain.grid.hadoop.GridHadoopTaskOutput output(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo)
                                                     throws org.gridgain.grid.GridException

Parameters:

taskInfo - Task info.

Returns:

Output.

Throws:

org.gridgain.grid.GridException

input

public org.gridgain.grid.hadoop.GridHadoopTaskInput input(org.gridgain.grid.hadoop.GridHadoopTaskInfo taskInfo)
                                                   throws org.gridgain.grid.GridException

Parameters:

taskInfo - Task info.

Returns:

Input.

Throws:

org.gridgain.grid.GridException

jobFinished

public void jobFinished(org.gridgain.grid.hadoop.GridHadoopJobId jobId)

Parameters:

jobId - Job id.

flush

public org.gridgain.grid.GridFuture<?> flush(org.gridgain.grid.hadoop.GridHadoopJobId jobId)

Flushes all the outputs for the given job to remote nodes.

Parameters:

jobId - Job ID.

Returns:

Future.

memory

public org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory memory()

Returns:

Memory.