Package 

Interface Tokenizer

    • Method Summary

      Modifier and Type Method Description
      abstract Array<String> tokenize(TokenizerContext context, String text)

      • Methods inherited from class ai.tock.nlp.model.service.engine.Tokenizer

        equals, hashCode, toString

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait