org.deeplearning4j.nn.conf.layers

Class LearnedSelfAttentionLayer.Builder

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer.Builder<T>

org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder<T>

org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder<LearnedSelfAttentionLayer.Builder>

org.deeplearning4j.nn.conf.layers.LearnedSelfAttentionLayer.Builder

Enclosing class:

LearnedSelfAttentionLayer

public static class LearnedSelfAttentionLayer.Builder
extends SameDiffLayer.Builder<LearnedSelfAttentionLayer.Builder>

Field Summary

Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder

paramWeightInit, weightInit

Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder

biasUpdater, regularization, regularizationBias, updater

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder

allParamConstraints, biasConstraints, iDropout, layerName, weightConstraints

Constructor Summary

Constructors

Constructor and Description
Builder()

Method Summary

Modifier and Type	Method and Description
LearnedSelfAttentionLayer	build()
LearnedSelfAttentionLayer.Builder	headSize(int headSize) Size of attention heads
LearnedSelfAttentionLayer.Builder	nHeads(int nHeads) Number of Attention Heads
LearnedSelfAttentionLayer.Builder	nIn(int nIn)
LearnedSelfAttentionLayer.Builder	nOut(int nOut)
LearnedSelfAttentionLayer.Builder	nQueries(int nQueries) Number of queries to learn
LearnedSelfAttentionLayer.Builder	projectInput(boolean projectInput) Project input before applying attention or not.

Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder

weightInit, weightInit

Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder

biasUpdater, l1, l1Bias, l2, l2Bias, regularization, regularizationBias, updater, weightDecay, weightDecay, weightDecayBias, weightDecayBias

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder

constrainAllParameters, constrainBias, constrainWeights, dropOut, dropOut, name

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Builder

public Builder()

Method Detail

nIn

public LearnedSelfAttentionLayer.Builder nIn(int nIn)

Parameters:

nIn - Number of inputs to the layer (input size)

nOut

public LearnedSelfAttentionLayer.Builder nOut(int nOut)

Parameters:

nOut - Number of outputs (output size)

nHeads

public LearnedSelfAttentionLayer.Builder nHeads(int nHeads)

Number of Attention Heads

headSize

public LearnedSelfAttentionLayer.Builder headSize(int headSize)

Size of attention heads

projectInput

public LearnedSelfAttentionLayer.Builder projectInput(boolean projectInput)

Project input before applying attention or not.

nQueries

public LearnedSelfAttentionLayer.Builder nQueries(int nQueries)

Number of queries to learn

build

public LearnedSelfAttentionLayer build()

Specified by:

build in class Layer.Builder<LearnedSelfAttentionLayer.Builder>