ml.dmlc.xgboost4j.java

Class XGBoostSetupTask

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<T>

ml.dmlc.xgboost4j.java.XGBoostSetupTask

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable<XGBoostSetupTask>

public class XGBoostSetupTask
extends water.MRTask<T>

Initializes XGBoost training (converts Frame to set of node-local DMatrices)

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	XGBoostSetupTask.FrameNodes

Nested classes/interfaces inherited from class water.MRTask

water.MRTask.PostMapAction<T extends water.MRTask.PostMapAction<T>>

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex

Constructor Summary

Constructors

Constructor and Description
XGBoostSetupTask(XGBoostModel model, XGBoostModel.XGBoostParameters parms, BoosterParms boosterParms, byte[] checkpointToResume, java.util.Map<java.lang.String,java.lang.String> rabitEnv, XGBoostSetupTask.FrameNodes trainFrame)

Method Summary

Modifier and Type	Method and Description
protected void	execute()
static XGBoostSetupTask.FrameNodes	findFrameNodes(water.fvec.Frame fr) Finds what nodes actually do carry some of data of a given Frame
T	run() Alias to doAllNodes() - the XGBoost task will actually run only on selected nodes.
protected void	setupLocal()

Methods inherited from class water.MRTask

appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, profile, profString, reduce, self, withPostMapAction

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

XGBoostSetupTask

public XGBoostSetupTask(XGBoostModel model,
                        XGBoostModel.XGBoostParameters parms,
                        BoosterParms boosterParms,
                        byte[] checkpointToResume,
                        java.util.Map<java.lang.String,java.lang.String> rabitEnv,
                        XGBoostSetupTask.FrameNodes trainFrame)

Method Detail

execute

protected void execute()

findFrameNodes

public static XGBoostSetupTask.FrameNodes findFrameNodes(water.fvec.Frame fr)

Finds what nodes actually do carry some of data of a given Frame

Parameters:

fr - frame to find nodes for

Returns:

FrameNodes

setupLocal

protected final void setupLocal()

Overrides:

setupLocal in class water.MRTask<T extends water.MRTask<T>>

run

public T run()

Alias to doAllNodes() - the XGBoost task will actually run only on selected nodes. We use doAllNodes() to make sure the reduce() operations defined on the tasks will be invoked even if there was no work done on the node from MRTask's point of view.