org.gridgain.grid.kernal.processors.hadoop.v1

Class GridHadoopV1Splitter

java.lang.Object

org.gridgain.grid.kernal.processors.hadoop.v1.GridHadoopV1Splitter

public class GridHadoopV1Splitter
extends Object

Hadoop API v1 splitter.

Constructor Summary

Constructors

Constructor and Description
GridHadoopV1Splitter()

Method Summary

Methods

Modifier and Type	Method and Description
static org.gridgain.grid.hadoop.GridHadoopFileBlock	readFileBlock(Class<?> cls, org.apache.hadoop.fs.FSDataInputStream in, String[] hosts)
static Collection<org.gridgain.grid.hadoop.GridHadoopInputSplit>	splitJob(org.apache.hadoop.mapred.JobConf jobConf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridHadoopV1Splitter

public GridHadoopV1Splitter()

Method Detail

splitJob

public static Collection<org.gridgain.grid.hadoop.GridHadoopInputSplit> splitJob(org.apache.hadoop.mapred.JobConf jobConf)
                                                                          throws org.gridgain.grid.GridException

Parameters:

jobConf - Job configuration.

Returns:

Collection of mapped splits.

Throws:

org.gridgain.grid.GridException - If mapping failed.

readFileBlock

@Nullable
public static org.gridgain.grid.hadoop.GridHadoopFileBlock readFileBlock(Class<?> cls,
                                                                  org.apache.hadoop.fs.FSDataInputStream in,
                                                                  @Nullable
                                                                  String[] hosts)
                                                                  throws org.gridgain.grid.GridException

Parameters:

cls - Input split class.

in - Input stream.

hosts - Optional hosts.

Returns:

File block or null if it is not a FileSplit instance.

Throws:

org.gridgain.grid.GridException - If failed.