org.apache.hadoop.tools.rumen
Class LoggedJob

java.lang.Object
  org.apache.hadoop.tools.rumen.LoggedJob

All Implemented Interfaces:

DeepCompare

Direct Known Subclasses:

ParsedJob

public class LoggedJob
extends Object
implements DeepCompare

A LoggedDiscreteCDF is a representation of an hadoop job, with the details of this class set up to meet the requirements of the Jackson JSON parser/generator. All of the public methods are simply accessors for the instance variables we want to write out in the JSON files.

Nested Class Summary

static class	LoggedJob.JobPriority
static class	LoggedJob.JobType

Method Summary

void	deepCompare(DeepCompare comparand, TreePath loc)
int	getClusterMapMB()
int	getClusterReduceMB()
long	getComputonsPerMapInputByte()
long	getComputonsPerMapOutputByte()
long	getComputonsPerReduceInputByte()
long	getComputonsPerReduceOutputByte()
List<String>	getDirectDependantJobs()
ArrayList<LoggedDiscreteCDF>	getFailedMapAttemptCDFs()
double	getFailedMapperFraction()
LoggedDiscreteCDF	getFailedReduceAttemptCDF()
long	getFinishTime()
int	getHeapMegabytes()
org.apache.hadoop.mapreduce.JobID	getJobID()
int	getJobMapMB()
JobName	getJobName()
JobProperties	getJobProperties() Get the configuration properties of the job.
int	getJobReduceMB()
LoggedJob.JobType	getJobtype()
long	getLaunchTime()
double[]	getMapperTriesToSucceed()
List<LoggedTask>	getMapTasks()
List<LoggedTask>	getOtherTasks()
Pre21JobHistoryConstants.Values	getOutcome()
LoggedJob.JobPriority	getPriority()
QueueName	getQueue()
List<LoggedTask>	getReduceTasks()
long	getRelativeTime()
long	getSubmitTime()
ArrayList<LoggedDiscreteCDF>	getSuccessfulMapAttemptCDFs()
LoggedDiscreteCDF	getSuccessfulReduceAttemptCDF()
int	getTotalMaps()
int	getTotalReduces()
UserName	getUser()
void	setUnknownAttribute(String attributeName, Object ignored)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getJobProperties

public JobProperties getJobProperties()

Get the configuration properties of the job.

setUnknownAttribute

public void setUnknownAttribute(String attributeName,
                                Object ignored)

getUser

public UserName getUser()

getJobID

public org.apache.hadoop.mapreduce.JobID getJobID()

getPriority

public LoggedJob.JobPriority getPriority()

getComputonsPerMapInputByte

public long getComputonsPerMapInputByte()

getComputonsPerMapOutputByte

public long getComputonsPerMapOutputByte()

getComputonsPerReduceInputByte

public long getComputonsPerReduceInputByte()

getComputonsPerReduceOutputByte

public long getComputonsPerReduceOutputByte()

getSubmitTime

public long getSubmitTime()

getLaunchTime

public long getLaunchTime()

getFinishTime

public long getFinishTime()

getHeapMegabytes

public int getHeapMegabytes()

getTotalMaps

public int getTotalMaps()

getTotalReduces

public int getTotalReduces()

getOutcome

public Pre21JobHistoryConstants.Values getOutcome()

getJobtype

public LoggedJob.JobType getJobtype()

getDirectDependantJobs

public List<String> getDirectDependantJobs()

getMapTasks

public List<LoggedTask> getMapTasks()

getReduceTasks

public List<LoggedTask> getReduceTasks()

getOtherTasks

public List<LoggedTask> getOtherTasks()

getSuccessfulMapAttemptCDFs

public ArrayList<LoggedDiscreteCDF> getSuccessfulMapAttemptCDFs()

getFailedMapAttemptCDFs

public ArrayList<LoggedDiscreteCDF> getFailedMapAttemptCDFs()

getSuccessfulReduceAttemptCDF

public LoggedDiscreteCDF getSuccessfulReduceAttemptCDF()

getFailedReduceAttemptCDF

public LoggedDiscreteCDF getFailedReduceAttemptCDF()

getMapperTriesToSucceed

public double[] getMapperTriesToSucceed()

getFailedMapperFraction

public double getFailedMapperFraction()

getRelativeTime

public long getRelativeTime()

getQueue

public QueueName getQueue()

Returns:

job queue name if it is available in job history file or job history conf file. Returns null otherwise.

getJobName

public JobName getJobName()

getClusterMapMB

public int getClusterMapMB()

getClusterReduceMB

public int getClusterReduceMB()

getJobMapMB

public int getJobMapMB()

getJobReduceMB

public int getJobReduceMB()

deepCompare

public void deepCompare(DeepCompare comparand,
                        TreePath loc)
                 throws DeepInequalityException

Specified by:

deepCompare in interface DeepCompare

Parameters:

comparand - the other comparand that's being compared to me

loc - the path that got to me. In the root, myLocation is null. To process the scalar foo field of the root we will make a recursive call with a TreePath whose fieldName is "bar" and whose index is -1 and whose parent is null. To process the plural bar field of the root we will make a recursive call with a TreePath whose fieldName is "foo" and whose index is -1 and whose parent is also null.

Throws:

DeepInequalityException