com.hankcs.hanlp.tokenizer

类

• BasicTokenizer
• IndexTokenizer
• NLPTokenizer
• NotionalTokenizer
• SpeedTokenizer
• StandardTokenizer
• TraditionalChineseTokenizer
• URLTokenizer