Package ai.djl.training.tracker

Contains classes for having a gradually changing hyper-parameter.

It contains a main interface Tracker and various options that extend it.

Interface Summary

Interface	Description
CyclicalTracker.ScaleFunction	ScaleFunction is an interface to implement a custom scale function.
ParameterTracker	A Tracker represents a collection of hyperparameters or Trackers that changes gradually through the training process.
Tracker	A Tracker represents a hyperparameter that changes gradually through the training process.

Class Summary

Class	Description
CosineTracker	CosineTracker is an implementation of Tracker which is updated by taking sections of a cosine curve to smoothly reduce learning rate until a specified step and base learning rate.
CosineTracker.Builder	The Builder to construct an CosineTracker object.
CyclicalTracker	CyclicalTracker is an implementation of Tracker which is a policy of learning rate adjustment that increases the learning rate off a base value in a cyclical nature, as detailed in the paper Cyclical Learning Rates for Training Neural Networks.
CyclicalTracker.Builder	The Builder to construct an CyclicalTracker object.
FactorTracker	FactorTracker is an implementation of Tracker which is updated by a multiplicative factor.
FactorTracker.Builder	The Builder to construct an FactorTracker object.
FixedPerVarTracker	FixedPerVarTracker is an implementation of Tracker which returns a fixed value.
FixedPerVarTracker.Builder	The Builder to construct an FixedPerVarTracker object.
LinearTracker	FactorTracker is an implementation of Tracker which is updated by a constant factor.
LinearTracker.Builder	The Builder to construct an LinearTracker object.
MultiFactorTracker	MultiFactorTracker is an implementation of Tracker which returns piecewise constant values for fixed numbers of steps.
MultiFactorTracker.Builder	The Builder to construct an MultiFactorTracker object.
PolynomialDecayTracker	Polynomial decay Tracker.
PolynomialDecayTracker.Builder	Builder for PolynomialDecayTracker.
WarmUpTracker	A WarmUpTracker applies a simple warm-up before executing a main Tracker.
WarmUpTracker.Builder	The Builder to construct a WarmUpTracker.

Enum Summary

Enum	Description
CyclicalTracker.CyclicalMode	CyclicalTracker provides three predefined cyclical modes and can be selected by this enum.
WarmUpTracker.Mode	An enum that enumerates the types of warm-up modes for a WarmUpTracker.