org.deeplearning4j.nn.layers.recurrent

Class CudnnLSTMHelper

java.lang.Object

org.deeplearning4j.nn.layers.BaseCudnnHelper

org.deeplearning4j.nn.layers.recurrent.CudnnLSTMHelper

All Implemented Interfaces:

org.deeplearning4j.nn.layers.LayerHelper, org.deeplearning4j.nn.layers.recurrent.LSTMHelper

public class CudnnLSTMHelper
extends BaseCudnnHelper
implements org.deeplearning4j.nn.layers.recurrent.LSTMHelper

cuDNN-based helper for the recurrent LSTM layer (no peephole connections).

Author:

saudet

Nested Class Summary

Nested classes/interfaces inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

BaseCudnnHelper.CudnnContext, BaseCudnnHelper.DataCache, BaseCudnnHelper.TensorArray

Field Summary

Fields

Modifier and Type	Field and Description
protected static boolean	BIDIRECTIONAL
protected static float	DROPOUT
protected static int	NUM_LAYERS
protected static int	NUM_LINEAR_LAYERS
protected static int	RNN_MODE

Fields inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

alpha, beta, dataType, dataTypeSize, sizeInBytes, TENSOR_FORMAT

Constructor Summary

Constructors

Constructor and Description
CudnnLSTMHelper()

Method Summary

Modifier and Type	Method and Description
org.deeplearning4j.nn.layers.recurrent.FwdPassReturn	activate(org.deeplearning4j.nn.api.Layer layer, org.deeplearning4j.nn.conf.NeuralNetConfiguration conf, IActivation gateActivationFn, INDArray input, INDArray recurrentWeights, INDArray inputWeights, INDArray biases, boolean training, INDArray prevOutputActivations, INDArray prevMemCellState, boolean forBackprop, boolean forwards, String inputWeightKey, INDArray maskArray, boolean hasPeepholeConnections, org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)
org.nd4j.linalg.primitives.Pair<org.deeplearning4j.nn.gradient.Gradient,INDArray>	backpropGradient(org.deeplearning4j.nn.conf.NeuralNetConfiguration conf, IActivation gateActivationFn, INDArray input, INDArray recurrentWeights, INDArray inputWeights, INDArray epsilon, boolean truncatedBPTT, int tbpttBackwardLength, org.deeplearning4j.nn.layers.recurrent.FwdPassReturn fwdPass, boolean forwards, String inputWeightKey, String recurrentWeightKey, String biasWeightKey, Map<String,INDArray> gradientViews, INDArray maskArray, boolean hasPeepholeConnections, org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)
boolean	checkSupported(IActivation gateActivationFn, IActivation activationFn, boolean hasPeepholeConnections)
Map<String,Long>	helperMemoryUse()

Methods inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

adaptForTensorDescr, checkCuda, checkCudnn, checkSupported, toCudnnDataType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NUM_LAYERS

protected static final int NUM_LAYERS

See Also:

Constant Field Values

DROPOUT

protected static final float DROPOUT

See Also:

Constant Field Values

BIDIRECTIONAL

protected static final boolean BIDIRECTIONAL

See Also:

Constant Field Values

RNN_MODE

protected static final int RNN_MODE

See Also:

Constant Field Values

NUM_LINEAR_LAYERS

protected static final int NUM_LINEAR_LAYERS

See Also:

Constant Field Values

Constructor Detail

CudnnLSTMHelper

public CudnnLSTMHelper()

Method Detail

checkSupported

public boolean checkSupported(IActivation gateActivationFn,
                              IActivation activationFn,
                              boolean hasPeepholeConnections)

Specified by:

checkSupported in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper

backpropGradient

public org.nd4j.linalg.primitives.Pair<org.deeplearning4j.nn.gradient.Gradient,INDArray> backpropGradient(org.deeplearning4j.nn.conf.NeuralNetConfiguration conf,
                                                                                                          IActivation gateActivationFn,
                                                                                                          INDArray input,
                                                                                                          INDArray recurrentWeights,
                                                                                                          INDArray inputWeights,
                                                                                                          INDArray epsilon,
                                                                                                          boolean truncatedBPTT,
                                                                                                          int tbpttBackwardLength,
                                                                                                          org.deeplearning4j.nn.layers.recurrent.FwdPassReturn fwdPass,
                                                                                                          boolean forwards,
                                                                                                          String inputWeightKey,
                                                                                                          String recurrentWeightKey,
                                                                                                          String biasWeightKey,
                                                                                                          Map<String,INDArray> gradientViews,
                                                                                                          INDArray maskArray,
                                                                                                          boolean hasPeepholeConnections,
                                                                                                          org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)

Specified by:

backpropGradient in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper

activate

public org.deeplearning4j.nn.layers.recurrent.FwdPassReturn activate(org.deeplearning4j.nn.api.Layer layer,
                                                                     org.deeplearning4j.nn.conf.NeuralNetConfiguration conf,
                                                                     IActivation gateActivationFn,
                                                                     INDArray input,
                                                                     INDArray recurrentWeights,
                                                                     INDArray inputWeights,
                                                                     INDArray biases,
                                                                     boolean training,
                                                                     INDArray prevOutputActivations,
                                                                     INDArray prevMemCellState,
                                                                     boolean forBackprop,
                                                                     boolean forwards,
                                                                     String inputWeightKey,
                                                                     INDArray maskArray,
                                                                     boolean hasPeepholeConnections,
                                                                     org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)

Specified by:

activate in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper

helperMemoryUse

public Map<String,Long> helperMemoryUse()

Specified by:

helperMemoryUse in interface org.deeplearning4j.nn.layers.LayerHelper