ai.tock.nlp.model.service.engine

Class NlpTokenizer

ai.tock.nlp.model.service.engine.NlpTokenizer

All Implemented Interfaces:

Tokenizer

@ThreadSafe
public class NlpTokenizer
implements Tokenizer

Constructor Summary

Constructors

Constructor and Description
NlpTokenizer(TokenizerModelHolder model)

Method Summary

Modifier and Type	Method and Description
TokenizerModelHolder	getModel()

Methods inherited from interface ai.tock.nlp.model.service.engine.Tokenizer

tokenize

Constructor Detail

NlpTokenizer

public NlpTokenizer(@NotNull
                    TokenizerModelHolder model)

Method Detail

getModel

@NotNull
public TokenizerModelHolder getModel()