Package org.nd4j.weightinit.impl

Interface Summary

Interface	Description
NDArraySupplierInitScheme.NDArraySupplier	A simple facade

Class Summary

Class	Description
ConstantInitScheme	Initialize the weight to zero.
DistributionInitScheme	Initialize the weights based on a given Distribution
IdentityInitScheme	Initialize the weight to one.
LecunUniformInitScheme	Initialize the weight to: randn(shape) //N(0, 2/nIn);
NDArraySupplierInitScheme
OneInitScheme	Initialize the weight to one.
ReluInitScheme	Initialize the weight to: randn(shape) //N(0, 2/nIn);
ReluUniformInitScheme	Initialize the weight to: U(-sqrt(6/fanIn), sqrt(6/fanIn)
SigmoidUniformInitScheme	Initialize the weight to: range = 4.0 * Math.sqrt(6.0 / (fanIn + fanOut)) U(-range,range)
UniformInitScheme	Initialize the weight to: range = 1.0 / Math.sqrt(fanIn) U(-range,range)
VarScalingNormalFanAvgInitScheme	Initialize the weight to: U / sqrt((fanin _ fanout) / 2)
VarScalingNormalFanInInitScheme	Initialize the weight to: U / fanIn
VarScalingNormalFanOutInitScheme	Initialize the weight to: U / sqrt(fanout)
VarScalingNormalUniformFanInInitScheme	Initialize the weight to: range = = 3.0 / Math.sqrt(fanIn) U(-range,range)
VarScalingNormalUniformFanOutInitScheme	Initialize the weight to: randn(shape) //N(0, 2/nIn);
VarScalingUniformFanAvgInitScheme	Initialize the weight to: range = = 3.0 / Math.sqrt((fanIn + fanOut) / 2) U(-range,range)
XavierFanInInitScheme	Initialize the weight to: randn(shape) //N(0, 2/nIn);
XavierInitScheme	Initialize the weight to: range = = U * sqrt(2.0 / (fanIn + fanOut)
XavierUniformInitScheme	Initialize the weight to: //As per Glorot and Bengio 2010: Uniform distribution U(-s,s) with s = sqrt(6/(fanIn + fanOut)) Eq 16: http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
ZeroInitScheme	Initialize the weight to zero.