com.hankcs.hanlp.corpus.dictionary

Class DictionaryMaker

java.lang.Object

com.hankcs.hanlp.corpus.dictionary.DictionaryMaker

All Implemented Interfaces:

ISaveAble

public class DictionaryMaker
extends Object
implements ISaveAble

一个通用的词典制作工具，词条格式：词 标签 频次

Author:

hankcs

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	DictionaryMaker.Filter

Constructor Summary

Constructors

Constructor and Description
DictionaryMaker()

Method Summary

Modifier and Type	Method and Description
void	add(Item item) 插入条目
void	add(IWord word) 向词典中加入一个词语
void	add(String param)
void	add(String value, String label)
void	addAll(List<Item> itemList) 插入全部条目
void	addAllNotCombine(List<Item> itemList) 插入新条目，不执行合并
void	addNotCombine(Item item) 插入条目，但是不合并，如果已有则忽略
static DictionaryMaker	combine(String... pathArray) 合并多部词典
static DictionaryMaker	combine(String pathA, String pathB) 合并两部词典
static DictionaryMaker	combineWhenNotInclude(String[] pathArray) 合并，只补充除第一个词典外其他词典的新词
static DictionaryMaker	combineWithNormalization(String[] pathArray) 对除第一个之外的词典执行标准化，并且合并
Set<Map.Entry<String,Item>>	entrySet() 浏览所有词条
Item	get(IWord word)
Item	get(String key)
Set<String>	keySet()
TreeSet<String>	labelSet()
static DictionaryMaker	load(String path) 从磁盘加载
static List<Item>	loadAsItemList(String path) 读取所有条目
static List<Item>	normalizeFrequency(List<Item> itemList) 调整频次，按排序后的次序给定频次
void	remove(String value) 删除一个词条
boolean	saveTxtTo(String path) 将自己以文本文档的方式保存到磁盘
boolean	saveTxtTo(String path, DictionaryMaker.Filter filter) 允许保存之前对其做一些调整
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DictionaryMaker

public DictionaryMaker()

Method Detail

add

public void add(IWord word)

向词典中加入一个词语

Parameters:

word - 词语

add

public void add(String value,
                String label)

remove

public void remove(String value)

删除一个词条

Parameters:

value -

get

public Item get(String key)

get

public Item get(IWord word)

labelSet

public TreeSet<String> labelSet()

loadAsItemList

public static List<Item> loadAsItemList(String path)

读取所有条目

Parameters:

path -

Returns:

load

public static DictionaryMaker load(String path)

从磁盘加载

Parameters:

path -

Returns:

addAll

public void addAll(List<Item> itemList)

插入全部条目

Parameters:

itemList -

addAllNotCombine

public void addAllNotCombine(List<Item> itemList)

插入新条目，不执行合并

Parameters:

itemList -

add

public void add(Item item)

插入条目

Parameters:

item -

entrySet

public Set<Map.Entry<String,Item>> entrySet()

浏览所有词条

Returns:

keySet

public Set<String> keySet()

addNotCombine

public void addNotCombine(Item item)

插入条目，但是不合并，如果已有则忽略

Parameters:

item -

combine

public static DictionaryMaker combine(String pathA,
                                      String pathB)

合并两部词典

Parameters:

pathA -

pathB -

Returns:

combine

public static DictionaryMaker combine(String... pathArray)

合并多部词典

Parameters:

pathArray -

Returns:

combineWithNormalization

public static DictionaryMaker combineWithNormalization(String[] pathArray)

对除第一个之外的词典执行标准化，并且合并

Parameters:

pathArray -

Returns:

combineWhenNotInclude

public static DictionaryMaker combineWhenNotInclude(String[] pathArray)

合并，只补充除第一个词典外其他词典的新词

Parameters:

pathArray -

Returns:

toString

public String toString()

Overrides:

toString in class Object

saveTxtTo

public boolean saveTxtTo(String path)

Description copied from interface: ISaveAble

将自己以文本文档的方式保存到磁盘

Specified by:

saveTxtTo in interface ISaveAble

Parameters:

path - 保存位置，包含文件名，不一定包含后缀

Returns:

是否成功

add

public void add(String param)

saveTxtTo

public boolean saveTxtTo(String path,
                         DictionaryMaker.Filter filter)

允许保存之前对其做一些调整

Parameters:

path -

filter -

Returns:

normalizeFrequency

public static List<Item> normalizeFrequency(List<Item> itemList)

调整频次，按排序后的次序给定频次

Parameters:

itemList -

Returns:

处理后的列表