org.deeplearning4j.nn.conf.layers

Class SelfAttentionLayer.Builder

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer.Builder<T>

org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder<T>

org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder<SelfAttentionLayer.Builder>

org.deeplearning4j.nn.conf.layers.SelfAttentionLayer.Builder

Enclosing class:

SelfAttentionLayer

public static class SelfAttentionLayer.Builder
extends SameDiffLayer.Builder<SelfAttentionLayer.Builder>

Field Summary

Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder

paramWeightInit, weightInit

Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder

biasUpdater, regularization, regularizationBias, updater

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder

allParamConstraints, biasConstraints, iDropout, layerName, weightConstraints

Constructor Summary

Constructors

Constructor and Description
Builder()

Method Summary

Modifier and Type	Method and Description
SelfAttentionLayer	build()
SelfAttentionLayer.Builder	headSize(int headSize) Size of attention heads
SelfAttentionLayer.Builder	nHeads(int nHeads) Number of Attention Heads
SelfAttentionLayer.Builder	nIn(int nIn)
SelfAttentionLayer.Builder	nOut(int nOut)
SelfAttentionLayer.Builder	projectInput(boolean projectInput) Project input before applying attention or not.

Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder

weightInit, weightInit

Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder

biasUpdater, l1, l1Bias, l2, l2Bias, regularization, regularizationBias, updater, weightDecay, weightDecay, weightDecayBias, weightDecayBias

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder

constrainAllParameters, constrainBias, constrainWeights, dropOut, dropOut, name

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Builder

public Builder()

Method Detail

nIn

public SelfAttentionLayer.Builder nIn(int nIn)

Parameters:

nIn - Number of inputs to the layer (input size)

nOut

public SelfAttentionLayer.Builder nOut(int nOut)

Parameters:

nOut - Number of outputs (output size)

nHeads

public SelfAttentionLayer.Builder nHeads(int nHeads)

Number of Attention Heads

headSize

public SelfAttentionLayer.Builder headSize(int headSize)

Size of attention heads

projectInput

public SelfAttentionLayer.Builder projectInput(boolean projectInput)

Project input before applying attention or not.

build

public SelfAttentionLayer build()

Specified by:

build in class Layer.Builder<SelfAttentionLayer.Builder>