com.hankcs.hanlp.seg

Class CharacterBasedSegment

java.lang.Object

com.hankcs.hanlp.seg.Segment

com.hankcs.hanlp.seg.CharacterBasedSegment

Direct Known Subclasses:

AbstractLexicalAnalyzer, CRFSegment, HMMSegment

public abstract class CharacterBasedSegment
extends Segment

基于“由字构词”方法分词器基类

Author:

hankcs

Field Summary

Fields inherited from class com.hankcs.hanlp.seg.Segment

config

Constructor Summary

Constructors

Constructor and Description
CharacterBasedSegment()

Method Summary

Modifier and Type	Method and Description
static CoreDictionary.Attribute	guessAttribute(Term term) 查询或猜测一个词语的属性， 先查词典，然后对字母、数字串的属性进行判断，最后猜测未登录词
protected abstract List<Term>	roughSegSentence(char[] sentence) 单纯的分词模型实现该方法，仅输出词
protected List<Term>	segSentence(char[] sentence) 以下方法用于纯分词模型 分词、词性标注联合模型则直接重载segSentence
protected List<Vertex>	toVertexList(List<Term> wordList, boolean appendStart) 将中间结果转换为词网顶点, 这样就可以利用基于Vertex开发的功能, 如词性标注、NER等

Methods inherited from class com.hankcs.hanlp.seg.Segment

atomSegment, combineByCustomDictionary, combineByCustomDictionary, convert, enableAllNamedEntityRecognize, enableCustomDictionary, enableCustomDictionaryForcing, enableIndexMode, enableIndexMode, enableJapaneseNameRecognize, enableMultithreading, enableMultithreading, enableNameRecognize, enableNumberQuantifierRecognize, enableOffset, enableOrganizationRecognize, enablePartOfSpeechTagging, enablePlaceRecognize, enableTranslatedNameRecognize, mergeNumberQuantifier, quickAtomSegment, seg, seg, seg2sentence, simpleAtomSegment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CharacterBasedSegment

public CharacterBasedSegment()

Method Detail

guessAttribute

public static CoreDictionary.Attribute guessAttribute(Term term)

查询或猜测一个词语的属性， 先查词典，然后对字母、数字串的属性进行判断，最后猜测未登录词

Parameters:

term -

Returns:

segSentence

protected List<Term> segSentence(char[] sentence)

以下方法用于纯分词模型 分词、词性标注联合模型则直接重载segSentence

Specified by:

segSentence in class Segment

Parameters:

sentence - 待分词句子

Returns:

单词列表

roughSegSentence

protected abstract List<Term> roughSegSentence(char[] sentence)

单纯的分词模型实现该方法，仅输出词

Parameters:

sentence -

Returns:

toVertexList

protected List<Vertex> toVertexList(List<Term> wordList,
                                    boolean appendStart)

将中间结果转换为词网顶点, 这样就可以利用基于Vertex开发的功能, 如词性标注、NER等

Parameters:

wordList -

appendStart -

Returns: