hex

Class FrameTask<T extends FrameTask<T>>

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<T>

hex.FrameTask<T>

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable

Direct Known Subclasses:

CoxPH.CoxPHTask, DeepLearningTask, Gram.GramTask

public abstract class FrameTask<T extends FrameTask<T>>
extends water.MRTask<T>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields

Modifier and Type	Field and Description
protected DataInfo	_dinfo
protected water.Key	_jobKey
protected boolean	_shuffle
protected float	_useFraction

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nrite, _nxx, _rite, _topLocal

Fields inherited from class water.DTask

_ex, _modifiesInputs

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	FrameTask(FrameTask ft)
	FrameTask(water.Key jobKey, DataInfo dinfo)
	FrameTask(water.Key jobKey, DataInfo dinfo, water.H2O.H2OCountedCompleter cmp)
	FrameTask(water.Key jobKey, water.Key dinfoKey, int[] activeCols)
	FrameTask(water.Key jobKey, water.Key dinfoKey, int[] activeCols, water.H2O.H2OCountedCompleter cmp)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	chunkDone(long n) Override this to do post-chunk processing work.
protected void	chunkInit() Override this to initialize at the beginning of chunk processing.
protected void	closeLocal()
T	dfork(water.fvec.Frame fr)
DataInfo	dinfo()
void	map(water.fvec.Chunk[] chunks, water.fvec.NewChunk[] outputs) Extracts the values, applies regularization to numerics, adds appropriate offsets to categoricals, and adapts response according to the CaseMode/CaseValue if set.
protected void	processRow(long gid, DataInfo.Row r) Method to process one row of the data for GLM functions.
protected void	processRow(long gid, DataInfo.Row r, water.fvec.NewChunk[] outputs)
protected void	setupLocal()

Methods inherited from class water.MRTask

appendables, asyncExec, asyncExec, asyncExec, block, compute2, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, map, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, priority, profString, reduce

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

clone, compute, frozenType, icer, nextThrPriority, read_impl, read, readJSON_impl, readJSON, write_impl, write, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_dinfo

protected transient DataInfo _dinfo

_jobKey

protected final water.Key _jobKey

_useFraction

protected float _useFraction

_shuffle

protected boolean _shuffle

Constructor Detail

FrameTask

public FrameTask(water.Key jobKey,
         DataInfo dinfo)

FrameTask

public FrameTask(water.Key jobKey,
         DataInfo dinfo,
         water.H2O.H2OCountedCompleter cmp)

FrameTask

public FrameTask(water.Key jobKey,
         water.Key dinfoKey,
         int[] activeCols)

FrameTask

public FrameTask(water.Key jobKey,
         water.Key dinfoKey,
         int[] activeCols,
         water.H2O.H2OCountedCompleter cmp)

FrameTask

protected FrameTask(FrameTask ft)

Method Detail

dinfo

public DataInfo dinfo()

setupLocal

protected void setupLocal()

Overrides:

setupLocal in class water.MRTask<T extends FrameTask<T>>

closeLocal

protected void closeLocal()

Overrides:

closeLocal in class water.MRTask<T extends FrameTask<T>>

processRow

protected void processRow(long gid,
              DataInfo.Row r)

Method to process one row of the data for GLM functions. Numeric and categorical values are passed separately, as is response. Categoricals are passed as absolute indexes into the expanded beta vector, 0-levels are skipped (so the number of passed categoricals will not be the same for every row). Categorical expansion/indexing: Categoricals are placed in the beginning of the beta vector. Each cat variable with n levels is expanded into n-1 independent binary variables. Indexes in cats[] will point to the appropriate coefficient in the beta vector, so e.g. assume we have 2 categorical columns both with values A,B,C, then the following rows will have following indexes: A,A - ncats = 0, we do not pass any categorical here A,B - ncats = 1, indexes = [2] B,B - ncats = 2, indexes = [0,2] and so on

Parameters:

gid - - global id of this row, in [0,_adaptedFrame.numRows())

processRow

protected void processRow(long gid,
              DataInfo.Row r,
              water.fvec.NewChunk[] outputs)

dfork

public T dfork(water.fvec.Frame fr)

Overrides:

dfork in class water.MRTask<T extends FrameTask<T>>

chunkInit

protected void chunkInit()

Override this to initialize at the beginning of chunk processing.

chunkDone

protected void chunkDone(long n)

Override this to do post-chunk processing work.

Parameters:

n - Number of processed rows

map

public final void map(water.fvec.Chunk[] chunks,
       water.fvec.NewChunk[] outputs)

Extracts the values, applies regularization to numerics, adds appropriate offsets to categoricals, and adapts response according to the CaseMode/CaseValue if set.

Overrides:

map in class water.MRTask<T extends FrameTask<T>>