org.nd4j.linalg.learning

Class AdaDeltaUpdater

java.lang.Object

org.nd4j.linalg.learning.AdaDeltaUpdater

All Implemented Interfaces:

GradientUpdater<AdaDelta>

public class AdaDeltaUpdater
extends Object
implements GradientUpdater<AdaDelta>

http://www.matthewzeiler.com/pubs/googleTR2012/googleTR2012.pdf https://arxiv.org/pdf/1212.5701v1.pdf

Ada delta updater. More robust adagrad that keeps track of a moving window average of the gradient rather than the every decaying learning rates of adagrad

Author:

Adam Gibson

Constructor Summary

Constructors

Constructor and Description
AdaDeltaUpdater(AdaDelta config)

Method Summary

Modifier and Type	Method and Description
void	applyUpdater(INDArray gradient, int iteration, int epoch) Get the updated gradient for the given gradient and also update the state of ada delta.
void	setStateViewArray(INDArray viewArray, int[] gradientShape, char gradientOrder, boolean initialize) For the internal updater state (if any): set this to use the provided array.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.linalg.learning.GradientUpdater

getConfig

Constructor Detail

AdaDeltaUpdater

public AdaDeltaUpdater(AdaDelta config)

Method Detail

setStateViewArray

public void setStateViewArray(INDArray viewArray,
                              int[] gradientShape,
                              char gradientOrder,
                              boolean initialize)

Description copied from interface: GradientUpdater

For the internal updater state (if any): set this to use the provided array. Used during initialization, and when restoring the updater state (after serialization, for example)

Specified by:

setStateViewArray in interface GradientUpdater<AdaDelta>

Parameters:

viewArray - Array (that is a view of a larger array) to use for the state.

initialize - If true: the updater must initialize the view array. If false: no change to view array contents

applyUpdater

public void applyUpdater(INDArray gradient,
                         int iteration,
                         int epoch)

Get the updated gradient for the given gradient and also update the state of ada delta.

Specified by:

applyUpdater in interface GradientUpdater<AdaDelta>

Parameters:

gradient - the gradient to get the updated gradient for

iteration -