com.hankcs.hanlp.model.perceptron

Class PerceptronSegmenter

java.lang.Object

com.hankcs.hanlp.model.perceptron.InstanceConsumer

com.hankcs.hanlp.model.perceptron.PerceptronTagger

com.hankcs.hanlp.model.perceptron.PerceptronSegmenter

All Implemented Interfaces:

Segmenter

public class PerceptronSegmenter
extends PerceptronTagger
implements Segmenter

中文分词

Author:

hankcs

Field Summary

Fields inherited from class com.hankcs.hanlp.model.perceptron.PerceptronTagger

model

Constructor Summary

Constructors

Constructor and Description
PerceptronSegmenter() 加载配置文件指定的模型
PerceptronSegmenter(LinearModel cwsModel)
PerceptronSegmenter(String cwsModelFile)

Method Summary

Modifier and Type	Method and Description
protected Instance	createInstance(Sentence sentence, FeatureMap featureMap)
double[]	evaluate(String corpora) 性能测试
boolean	learn(String... words) 在线学习
boolean	learn(String segmentedSentence) 在线学习
List<String>	segment(String sentence) 中文分词
void	segment(String text, Instance instance, List<String> output)
void	segment(String text, List<String> output)
void	segment(String text, String normalized, List<String> output)

Methods inherited from class com.hankcs.hanlp.model.perceptron.PerceptronTagger

getModel, learn, learn

Methods inherited from class com.hankcs.hanlp.model.perceptron.InstanceConsumer

evaluate, evaluate, normalize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PerceptronSegmenter

public PerceptronSegmenter(LinearModel cwsModel)

PerceptronSegmenter

public PerceptronSegmenter(String cwsModelFile)
                    throws IOException

Throws:

IOException

PerceptronSegmenter

public PerceptronSegmenter()
                    throws IOException

加载配置文件指定的模型

Throws:

IOException

Method Detail

segment

public void segment(String text,
                    List<String> output)

segment

public void segment(String text,
                    String normalized,
                    List<String> output)

Specified by:

segment in interface Segmenter

segment

public void segment(String text,
                    Instance instance,
                    List<String> output)

segment

public List<String> segment(String sentence)

Description copied from interface: Segmenter

中文分词

Specified by:

segment in interface Segmenter

Parameters:

sentence - 文本

Returns:

词语

learn

public boolean learn(String segmentedSentence)

在线学习

Parameters:

segmentedSentence - 分好词的句子，空格或tab分割，不含词性

Returns:

是否学习成功（失败的原因是参数错误）

learn

public boolean learn(String... words)

在线学习

Parameters:

words - 分好词的句子

Returns:

是否学习成功（失败的原因是参数错误）

createInstance

protected Instance createInstance(Sentence sentence,
                                  FeatureMap featureMap)

Specified by:

createInstance in class InstanceConsumer

evaluate

public double[] evaluate(String corpora)
                  throws IOException

Description copied from class: PerceptronTagger

性能测试

Overrides:

evaluate in class PerceptronTagger

Parameters:

corpora - 数据集

Returns:

默认返回accuracy，有些子类可能返回P,R,F1

Throws:

IOException