org.deeplearning4j.nn.layers.normalization

Class CudnnBatchNormalizationHelper

java.lang.Object

org.deeplearning4j.nn.layers.BaseCudnnHelper

org.deeplearning4j.nn.layers.normalization.CudnnBatchNormalizationHelper

All Implemented Interfaces:

org.deeplearning4j.nn.layers.LayerHelper, org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

public class CudnnBatchNormalizationHelper
extends BaseCudnnHelper
implements org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

cuDNN-based helper for the batch normalization layer.

Author:

saudet

Nested Class Summary

Nested classes/interfaces inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

BaseCudnnHelper.CudnnContext, BaseCudnnHelper.DataCache, BaseCudnnHelper.TensorArray

Field Summary

Fields

Modifier and Type	Field and Description
protected int	batchNormMode

Fields inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

alpha, beta, dataType, dataTypeSize, sizeInBytes, TENSOR_FORMAT

Constructor Summary

Constructors

Constructor and Description
CudnnBatchNormalizationHelper()

Method Summary

Modifier and Type	Method and Description
org.nd4j.linalg.primitives.Pair<org.deeplearning4j.nn.gradient.Gradient,INDArray>	backpropGradient(INDArray input, INDArray epsilon, int[] shape, INDArray gamma, INDArray dGammaView, INDArray dBetaView, double eps, org.deeplearning4j.nn.workspace.LayerWorkspaceMgr layerWorkspaceMgr)
boolean	checkSupported(double eps)
INDArray	getMeanCache()
INDArray	getVarCache()
Map<String,Long>	helperMemoryUse()
INDArray	preOutput(INDArray x, boolean training, int[] shape, INDArray gamma, INDArray beta, INDArray mean, INDArray var, double decay, double eps, org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)

Methods inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

adaptForTensorDescr, checkCuda, checkCudnn, checkSupported, toCudnnDataType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

batchNormMode

protected final int batchNormMode

See Also:

Constant Field Values

Constructor Detail

CudnnBatchNormalizationHelper

public CudnnBatchNormalizationHelper()

Method Detail

checkSupported

public boolean checkSupported(double eps)

Specified by:

checkSupported in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

backpropGradient

public org.nd4j.linalg.primitives.Pair<org.deeplearning4j.nn.gradient.Gradient,INDArray> backpropGradient(INDArray input,
                                                                                                          INDArray epsilon,
                                                                                                          int[] shape,
                                                                                                          INDArray gamma,
                                                                                                          INDArray dGammaView,
                                                                                                          INDArray dBetaView,
                                                                                                          double eps,
                                                                                                          org.deeplearning4j.nn.workspace.LayerWorkspaceMgr layerWorkspaceMgr)

Specified by:

backpropGradient in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

preOutput

public INDArray preOutput(INDArray x,
                          boolean training,
                          int[] shape,
                          INDArray gamma,
                          INDArray beta,
                          INDArray mean,
                          INDArray var,
                          double decay,
                          double eps,
                          org.deeplearning4j.nn.workspace.LayerWorkspaceMgr workspaceMgr)

Specified by:

preOutput in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

getMeanCache

public INDArray getMeanCache()

Specified by:

getMeanCache in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

getVarCache

public INDArray getVarCache()

Specified by:

getVarCache in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

helperMemoryUse

public Map<String,Long> helperMemoryUse()

Specified by:

helperMemoryUse in interface org.deeplearning4j.nn.layers.LayerHelper