com.hankcs.hanlp.seg.Other

Class AhoCorasickDoubleArrayTrieSegment

java.lang.Object

com.hankcs.hanlp.seg.Segment

com.hankcs.hanlp.seg.DictionaryBasedSegment

com.hankcs.hanlp.seg.Other.AhoCorasickDoubleArrayTrieSegment

public class AhoCorasickDoubleArrayTrieSegment
extends DictionaryBasedSegment

使用AhoCorasickDoubleArrayTrie实现的最长分词器
需要用户调用setTrie()提供一个AhoCorasickDoubleArrayTrie

Author:

hankcs

Field Summary

Fields inherited from class com.hankcs.hanlp.seg.Segment

config, customDictionary

Constructor Summary

Constructors

Constructor and Description
AhoCorasickDoubleArrayTrieSegment()
AhoCorasickDoubleArrayTrieSegment(AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute> trie)
AhoCorasickDoubleArrayTrieSegment(String... dictionaryPaths) 加载自己的词典，构造分词器
AhoCorasickDoubleArrayTrieSegment(TreeMap<String,CoreDictionary.Attribute> dictionary)

Method Summary

Modifier and Type	Method and Description
Segment	enableCustomDictionary(boolean enable) 是否启用用户词典
AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute>	getTrie()
AhoCorasickDoubleArrayTrieSegment	loadDictionary(String... pathArray)
protected List<Term>	segSentence(char[] sentence) 给一个句子分词
void	setTrie(AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute> trie)

Methods inherited from class com.hankcs.hanlp.seg.DictionaryBasedSegment

enablePartOfSpeechTagging, posTag

Methods inherited from class com.hankcs.hanlp.seg.Segment

atomSegment, combineByCustomDictionary, combineByCustomDictionary, combineByCustomDictionary, combineByCustomDictionary, convert, enableAllNamedEntityRecognize, enableCustomDictionary, enableCustomDictionaryForcing, enableIndexMode, enableIndexMode, enableJapaneseNameRecognize, enableMultithreading, enableMultithreading, enableNameRecognize, enableNumberQuantifierRecognize, enableOffset, enableOrganizationRecognize, enablePlaceRecognize, enableTranslatedNameRecognize, mergeNumberQuantifier, quickAtomSegment, seg, seg, seg2sentence, seg2sentence, simpleAtomSegment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AhoCorasickDoubleArrayTrieSegment

public AhoCorasickDoubleArrayTrieSegment()
                                  throws IOException

Throws:

IOException

AhoCorasickDoubleArrayTrieSegment

public AhoCorasickDoubleArrayTrieSegment(TreeMap<String,CoreDictionary.Attribute> dictionary)

AhoCorasickDoubleArrayTrieSegment

public AhoCorasickDoubleArrayTrieSegment(AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute> trie)

AhoCorasickDoubleArrayTrieSegment

public AhoCorasickDoubleArrayTrieSegment(String... dictionaryPaths)
                                  throws IOException

加载自己的词典，构造分词器

Parameters:

dictionaryPaths - 任意数量个词典

Throws:

IOException - 加载过程中的IO异常

Method Detail

segSentence

protected List<Term> segSentence(char[] sentence)

Description copied from class: Segment

给一个句子分词

Specified by:

segSentence in class Segment

Parameters:

sentence - 待分词句子

Returns:

单词列表

enableCustomDictionary

public Segment enableCustomDictionary(boolean enable)

Description copied from class: Segment

是否启用用户词典

Overrides:

enableCustomDictionary in class DictionaryBasedSegment

getTrie

public AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute> getTrie()

setTrie

public void setTrie(AhoCorasickDoubleArrayTrie<CoreDictionary.Attribute> trie)

loadDictionary

public AhoCorasickDoubleArrayTrieSegment loadDictionary(String... pathArray)