com.hankcs.hanlp.mining.word

Class TermFrequencyCounter

java.lang.Object

com.hankcs.hanlp.summary.KeywordExtractor

com.hankcs.hanlp.mining.word.TermFrequencyCounter

All Implemented Interfaces:

Iterable<TermFrequency>, Collection<TermFrequency>

public class TermFrequencyCounter
extends KeywordExtractor
implements Collection<TermFrequency>

词频统计工具

Author:

hankcs

Field Summary

Fields inherited from class com.hankcs.hanlp.summary.KeywordExtractor

defaultSegment

Constructor Summary

Constructors

Constructor and Description
TermFrequencyCounter()
TermFrequencyCounter(Segment segment, boolean filterStopWord) 构造

Method Summary

Modifier and Type	Method and Description
void	add(List<Term> termList)
void	add(String document)
boolean	add(TermFrequency termFrequency)
boolean	addAll(Collection<? extends TermFrequency> c)
Collection<TermFrequency>	all() 所有词汇的频次
void	clear()
boolean	contains(Object o)
boolean	containsAll(Collection<?> c)
static List<String>	getKeywordList(String document, int size) 提取关键词（线程安全）
List<String>	getKeywords(List<Term> termList, int size) 提取关键词（非线程安全）
boolean	isEmpty()
Iterator<TermFrequency>	iterator()
boolean	remove(Object o)
boolean	removeAll(Collection<?> c)
boolean	retainAll(Collection<?> c)
int	size()
Object[]	toArray()
<T> T[]	toArray(T[] a)
Collection<TermFrequency>	top(int N) 取前N个高频词
String	toString()

Methods inherited from class com.hankcs.hanlp.summary.KeywordExtractor

filter, getKeywords, getKeywords, getSegment, setSegment, shouldInclude

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Collection

equals, hashCode, parallelStream, removeIf, spliterator, stream

Methods inherited from interface java.lang.Iterable

forEach

Constructor Detail

TermFrequencyCounter

public TermFrequencyCounter(Segment segment,
                            boolean filterStopWord)

构造

Parameters:

filterStopWord - 是否过滤停用词

segment - 分词器

TermFrequencyCounter

public TermFrequencyCounter()

Method Detail

add

public void add(String document)

add

public void add(List<Term> termList)

top

public Collection<TermFrequency> top(int N)

取前N个高频词

Parameters:

N -

Returns:

all

public Collection<TermFrequency> all()

所有词汇的频次

Returns:

size

public int size()

Specified by:

size in interface Collection<TermFrequency>

isEmpty

public boolean isEmpty()

Specified by:

isEmpty in interface Collection<TermFrequency>

contains

public boolean contains(Object o)

Specified by:

contains in interface Collection<TermFrequency>

iterator

public Iterator<TermFrequency> iterator()

Specified by:

iterator in interface Iterable<TermFrequency>

Specified by:

iterator in interface Collection<TermFrequency>

toArray

public Object[] toArray()

Specified by:

toArray in interface Collection<TermFrequency>

toArray

public <T> T[] toArray(T[] a)

Specified by:

toArray in interface Collection<TermFrequency>

add

public boolean add(TermFrequency termFrequency)

Specified by:

add in interface Collection<TermFrequency>

remove

public boolean remove(Object o)

Specified by:

remove in interface Collection<TermFrequency>

containsAll

public boolean containsAll(Collection<?> c)

Specified by:

containsAll in interface Collection<TermFrequency>

addAll

public boolean addAll(Collection<? extends TermFrequency> c)

Specified by:

addAll in interface Collection<TermFrequency>

removeAll

public boolean removeAll(Collection<?> c)

Specified by:

removeAll in interface Collection<TermFrequency>

retainAll

public boolean retainAll(Collection<?> c)

Specified by:

retainAll in interface Collection<TermFrequency>

clear

public void clear()

Specified by:

clear in interface Collection<TermFrequency>

getKeywords

public List<String> getKeywords(List<Term> termList,
                                int size)

提取关键词（非线程安全）

Specified by:

getKeywords in class KeywordExtractor

Parameters:

termList -

size -

Returns:

getKeywordList

public static List<String> getKeywordList(String document,
                                          int size)

提取关键词（线程安全）

Parameters:

document - 文档内容

size - 希望提取几个关键词

Returns:

一个列表

toString

public String toString()

Overrides:

toString in class Object