ai.djl.mxnet.zoo.nlp.qa

Class MxBertVocabulary

java.lang.Object

ai.djl.mxnet.zoo.nlp.qa.MxBertVocabulary

All Implemented Interfaces:

ai.djl.modality.nlp.Vocabulary

public class MxBertVocabulary
extends java.lang.Object
implements ai.djl.modality.nlp.Vocabulary

A MXNet implementation of Vocabulary.

Constructor Summary

Constructors

Constructor and Description
MxBertVocabulary()

Method Summary

Modifier and Type	Method and Description
boolean	contains(java.lang.String token)
long	getIndex(java.lang.String token)
java.lang.String	getToken(long index)
static MxBertVocabulary	parse(java.io.InputStream is) Parses the vocabulary file and create MxBertVocabulary.
static MxBertVocabulary	parse(java.nio.file.Path path) Parses the vocabulary file and create MxBertVocabulary.
static MxBertVocabulary	parse(java.lang.String url) Parses the vocabulary file and create MxBertVocabulary.
long	size()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MxBertVocabulary

public MxBertVocabulary()

Method Detail

parse

public static MxBertVocabulary parse(java.nio.file.Path path)

Parses the vocabulary file and create MxBertVocabulary.

Parameters:

path - the input file path

Returns:

an instance of MxBertVocabulary

parse

public static MxBertVocabulary parse(java.lang.String url)

Parses the vocabulary file and create MxBertVocabulary.

Parameters:

url - the input vocabulary file url

Returns:

an instance of MxBertVocabulary

parse

public static MxBertVocabulary parse(java.io.InputStream is)

Parses the vocabulary file and create MxBertVocabulary.

Parameters:

is - the input InputStream of the vocabulary file

Returns:

an instance of MxBertVocabulary

getIndex

public long getIndex(java.lang.String token)

Specified by:

getIndex in interface ai.djl.modality.nlp.Vocabulary

contains

public boolean contains(java.lang.String token)

Specified by:

contains in interface ai.djl.modality.nlp.Vocabulary

size

public long size()

Specified by:

size in interface ai.djl.modality.nlp.Vocabulary

getToken

public java.lang.String getToken(long index)

Specified by:

getToken in interface ai.djl.modality.nlp.Vocabulary