com.hankcs.hanlp.seg.Other

Class DoubleArrayTrieSegment

java.lang.Object

com.hankcs.hanlp.seg.Segment

com.hankcs.hanlp.seg.DictionaryBasedSegment

com.hankcs.hanlp.seg.Other.DoubleArrayTrieSegment

public class DoubleArrayTrieSegment
extends DictionaryBasedSegment

使用DoubleArrayTrie实现的最长分词器

Author:

hankcs

Field Summary

Fields

Modifier and Type	Field and Description
DoubleArrayTrie<CoreDictionary.Attribute>	trie 分词用到的trie树，可以直接赋值为自己的trie树（赋值操作不保证线程安全）

Fields inherited from class com.hankcs.hanlp.seg.Segment

config, customDictionary

Constructor Summary

Constructors

Constructor and Description
DoubleArrayTrieSegment() 使用核心词库的trie树构造分词器
DoubleArrayTrieSegment(DoubleArrayTrie<CoreDictionary.Attribute> trie) 根据自己的trie树构造分词器
DoubleArrayTrieSegment(String... dictionaryPaths) 加载自己的词典，构造分词器

Method Summary

Modifier and Type	Method and Description
protected List<Term>	segSentence(char[] sentence) 给一个句子分词

Methods inherited from class com.hankcs.hanlp.seg.DictionaryBasedSegment

enableCustomDictionary, enablePartOfSpeechTagging, posTag

Methods inherited from class com.hankcs.hanlp.seg.Segment

atomSegment, combineByCustomDictionary, combineByCustomDictionary, combineByCustomDictionary, combineByCustomDictionary, convert, enableAllNamedEntityRecognize, enableCustomDictionary, enableCustomDictionaryForcing, enableIndexMode, enableIndexMode, enableJapaneseNameRecognize, enableMultithreading, enableMultithreading, enableNameRecognize, enableNumberQuantifierRecognize, enableOffset, enableOrganizationRecognize, enablePlaceRecognize, enableTranslatedNameRecognize, mergeNumberQuantifier, quickAtomSegment, seg, seg, seg2sentence, seg2sentence, simpleAtomSegment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

trie

public DoubleArrayTrie<CoreDictionary.Attribute> trie

分词用到的trie树，可以直接赋值为自己的trie树（赋值操作不保证线程安全）

Constructor Detail

DoubleArrayTrieSegment

public DoubleArrayTrieSegment()

使用核心词库的trie树构造分词器

DoubleArrayTrieSegment

public DoubleArrayTrieSegment(DoubleArrayTrie<CoreDictionary.Attribute> trie)

根据自己的trie树构造分词器

Parameters:

trie -

DoubleArrayTrieSegment

public DoubleArrayTrieSegment(String... dictionaryPaths)
                       throws IOException

加载自己的词典，构造分词器

Parameters:

dictionaryPaths - 任意数量个词典

Throws:

IOException - 加载过程中的IO异常

Method Detail

segSentence

protected List<Term> segSentence(char[] sentence)

Description copied from class: Segment

给一个句子分词

Specified by:

segSentence in class Segment

Parameters:

sentence - 待分词句子

Returns:

单词列表