com.hankcs.hanlp.dictionary.stopword

Class CoreStopWordDictionary

java.lang.Object

com.hankcs.hanlp.dictionary.stopword.CoreStopWordDictionary

public class CoreStopWordDictionary
extends Object

核心停用词词典

Author:

hankcs

Field Summary

Fields

Modifier and Type	Field and Description
static StopWordDictionary	dictionary 储存词条的结构
static Filter	FILTER 核心停用词典的核心过滤器，词性属于名词、动词、副词、形容词，并且不在停用词表中才不会被过滤

Constructor Summary

Constructors

Constructor and Description
CoreStopWordDictionary()

Method Summary

Modifier and Type	Method and Description
static boolean	add(String stopWord) 加入停用词到停用词词典中
static List<Term>	apply(List<Term> termList) 对分词结果应用过滤
static boolean	contains(String key)
static void	load(String coreStopWordDictionaryPath, boolean loadCacheIfPossible) 加载另一部停用词词典
static void	reload() 重新加载HanLP.Config#CoreStopWordDictionaryPath所指定的停用词词典，并且生成新缓存。
static boolean	remove(String stopWord) 从停用词词典中删除停用词
static boolean	shouldInclude(Term term) 是否应当将这个term纳入计算
static boolean	shouldRemove(Term term) 是否应当去掉这个词

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

dictionary

public static StopWordDictionary dictionary

储存词条的结构

FILTER

public static Filter FILTER

核心停用词典的核心过滤器，词性属于名词、动词、副词、形容词，并且不在停用词表中才不会被过滤

Constructor Detail

CoreStopWordDictionary

public CoreStopWordDictionary()

Method Detail

reload

public static void reload()

重新加载HanLP.Config#CoreStopWordDictionaryPath所指定的停用词词典，并且生成新缓存。

load

public static void load(String coreStopWordDictionaryPath,
                        boolean loadCacheIfPossible)

加载另一部停用词词典

Parameters:

coreStopWordDictionaryPath - 词典路径

loadCacheIfPossible - 是否优先加载缓存（速度更快）

contains

public static boolean contains(String key)

shouldInclude

public static boolean shouldInclude(Term term)

是否应当将这个term纳入计算

Parameters:

term -

Returns:

是否应当

shouldRemove

public static boolean shouldRemove(Term term)

是否应当去掉这个词

Parameters:

term - 词

Returns:

是否应当去掉

add

public static boolean add(String stopWord)

加入停用词到停用词词典中

Parameters:

stopWord - 停用词

Returns:

词典是否发生了改变

remove

public static boolean remove(String stopWord)

从停用词词典中删除停用词

Parameters:

stopWord - 停用词

Returns:

词典是否发生了改变

apply

public static List<Term> apply(List<Term> termList)

对分词结果应用过滤

Parameters:

termList -