org.gridgain.grid.kernal.processors.hadoop

Class GridHadoopUtils

java.lang.Object

org.gridgain.grid.kernal.processors.hadoop.GridHadoopUtils

public class GridHadoopUtils
extends Object

Hadoop utility methods.

Field Summary

Fields

Modifier and Type	Field and Description
static int	SPECULATIVE_CONCURRENCY Speculative concurrency on this machine.

Method Summary

Methods

Modifier and Type	Method and Description
static org.apache.hadoop.fs.Path	jobFile(org.apache.hadoop.conf.Configuration conf, String usr, org.apache.hadoop.mapreduce.JobID jobId) Gets job file.
static org.apache.hadoop.fs.Path	stagingAreaDir(org.apache.hadoop.conf.Configuration conf, String usr) Gets staging area directory.
static org.gridgain.grid.hadoop.GridHadoopJobStatus	status(GridHadoopJobMetadata meta) Convert Hadoop job metadata to job status.
static org.apache.hadoop.mapreduce.JobStatus	status(org.gridgain.grid.hadoop.GridHadoopJobStatus status, org.apache.hadoop.conf.Configuration conf) Convert GG job status to Hadoop job status.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SPECULATIVE_CONCURRENCY

public static final int SPECULATIVE_CONCURRENCY

Speculative concurrency on this machine. Mimics default public pool size calculation.

Method Detail

status

public static org.gridgain.grid.hadoop.GridHadoopJobStatus status(GridHadoopJobMetadata meta)

Convert Hadoop job metadata to job status.

Parameters:

meta - Metadata.

Returns:

Status.

status

public static org.apache.hadoop.mapreduce.JobStatus status(org.gridgain.grid.hadoop.GridHadoopJobStatus status,
                                           org.apache.hadoop.conf.Configuration conf)

Convert GG job status to Hadoop job status.

Parameters:

status - GG job status.

Returns:

Hadoop job status.

stagingAreaDir

public static org.apache.hadoop.fs.Path stagingAreaDir(org.apache.hadoop.conf.Configuration conf,
                                       String usr)

Gets staging area directory.

Parameters:

conf - Configuration.

usr - User.

Returns:

Staging area directory.

jobFile

public static org.apache.hadoop.fs.Path jobFile(org.apache.hadoop.conf.Configuration conf,
                                String usr,
                                org.apache.hadoop.mapreduce.JobID jobId)

Gets job file.

Parameters:

conf - Configuration.

usr - User.

jobId - Job ID.

Returns:

Job file.