com.hankcs.hanlp.mining.word

Class TfIdfCounter

java.lang.Object

com.hankcs.hanlp.summary.KeywordExtractor

com.hankcs.hanlp.mining.word.TfIdfCounter

public class TfIdfCounter
extends KeywordExtractor

TF-IDF统计工具兼关键词提取工具

Author:

hankcs

Field Summary

Fields inherited from class com.hankcs.hanlp.summary.KeywordExtractor

defaultSegment

Constructor Summary

Constructors

Constructor and Description
TfIdfCounter()
TfIdfCounter(boolean filterStopWord)
TfIdfCounter(Segment defaultSegment)
TfIdfCounter(Segment defaultSegment, boolean filterStopWord)

Method Summary

Modifier and Type	Method and Description
void	add(List<Term> termList)
void	add(Object id, List<Term> termList)
void	add(Object id, String text) 添加文档
int	add(String text) 添加文档，自动分配id
Map<String,Double>	allTf()
Map<Object,Map<String,Double>>	compute()
Set<Object>	documents()
List<String>	getKeywords(List<Term> termList, int size)
List<Map.Entry<String,Double>>	getKeywordsOf(Object id)
List<Map.Entry<String,Double>>	getKeywordsOf(Object id, int size)
List<Map.Entry<String,Double>>	getKeywordsWithTfIdf(List<Term> termList, int size)
List<Map.Entry<String,Double>>	getKeywordsWithTfIdf(String document, int size)
Map<Object,Map<String,Double>>	getTfMap()
void	loadIdfFile(String idfPath) 加载自定义idf文件
List<Map.Entry<String,Double>>	sortedAllTf()
List<Map.Entry<String,Integer>>	sortedAllTfInt()

Methods inherited from class com.hankcs.hanlp.summary.KeywordExtractor

filter, getKeywords, getKeywords, getSegment, setSegment, shouldInclude

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TfIdfCounter

public TfIdfCounter()

TfIdfCounter

public TfIdfCounter(boolean filterStopWord)

TfIdfCounter

public TfIdfCounter(Segment defaultSegment,
                    boolean filterStopWord)

TfIdfCounter

public TfIdfCounter(Segment defaultSegment)

Method Detail

getKeywords

public List<String> getKeywords(List<Term> termList,
                                int size)

Specified by:

getKeywords in class KeywordExtractor

getKeywordsWithTfIdf

public List<Map.Entry<String,Double>> getKeywordsWithTfIdf(String document,
                                                           int size)

getKeywordsWithTfIdf

public List<Map.Entry<String,Double>> getKeywordsWithTfIdf(List<Term> termList,
                                                           int size)

add

public void add(Object id,
                List<Term> termList)

add

public void add(List<Term> termList)

add

public void add(Object id,
                String text)

添加文档

Parameters:

id - 文档id

text - 文档内容

add

public int add(String text)

添加文档，自动分配id

Parameters:

text -

loadIdfFile

public void loadIdfFile(String idfPath)

加载自定义idf文件

Parameters:

idfPath -

compute

public Map<Object,Map<String,Double>> compute()

getKeywordsOf

public List<Map.Entry<String,Double>> getKeywordsOf(Object id)

getKeywordsOf

public List<Map.Entry<String,Double>> getKeywordsOf(Object id,
                                                    int size)

documents

public Set<Object> documents()

getTfMap

public Map<Object,Map<String,Double>> getTfMap()

sortedAllTf

public List<Map.Entry<String,Double>> sortedAllTf()

sortedAllTfInt

public List<Map.Entry<String,Integer>> sortedAllTfInt()

allTf

public Map<String,Double> allTf()