org.apdplat.word.analysis

Class TextSimilarity

java.lang.Object

org.apdplat.word.analysis.TextSimilarity

All Implemented Interfaces:

Similarity, SimilarityRanker

Direct Known Subclasses:

CosineTextSimilarity, EditDistanceTextSimilarity, EuclideanDistanceTextSimilarity, JaccardTextSimilarity, JaroDistanceTextSimilarity, ManhattanDistanceTextSimilarity, SimHashPlusHammingDistanceTextSimilarity, SimpleTextSimilarity, SørensenDiceCoefficientTextSimilarity

public abstract class TextSimilarity
extends Object
implements Similarity, SimilarityRanker

文本相似度

Author:

杨尚川

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	filterStopWord
protected static org.slf4j.Logger	LOGGER

Fields inherited from interface org.apdplat.word.analysis.Similarity

thresholdRate

Constructor Summary

Constructors

Constructor and Description
TextSimilarity()

Method Summary

Modifier and Type	Method and Description
protected abstract double	scoreImpl(List<Word> words1, List<Word> words2) 计算相似度分值
void	setSegmentationAlgorithm(SegmentationAlgorithm segmentationAlgorithm)
double	similarScore(List<Word> words1, List<Word> words2) 词列表1和词列表2的相似度分值
double	similarScore(String text1, String text2) 文本1和文本2的相似度分值
protected void	taggingWeightWithWordFrequency(List<Word> words1, List<Word> words2) 如果没有指定权重，则默认使用词频来标注词的权重 词频数据怎么来？ 一个词在词列表1中出现了几次，它在词列表1中的权重就是几 一个词在词列表2中出现了几次，它在词列表2中的权重就是几 标注好的权重存储在Word类的weight字段中
protected Map<String,Float>	toFastSearchMap(List<Word> words) 构造权重快速搜索容器

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apdplat.word.analysis.SimilarityRanker

main, rank, rank

Methods inherited from interface org.apdplat.word.analysis.Similarity

isSimilar, isSimilar, isSimilar, isSimilar, similarScore, similarScore

Field Detail

LOGGER

protected static final org.slf4j.Logger LOGGER

filterStopWord

protected boolean filterStopWord

Constructor Detail

TextSimilarity

public TextSimilarity()

Method Detail

setSegmentationAlgorithm

public void setSegmentationAlgorithm(SegmentationAlgorithm segmentationAlgorithm)

similarScore

public double similarScore(String text1,
                           String text2)

文本1和文本2的相似度分值

Specified by:

similarScore in interface Similarity

Parameters:

text1 - 文本1

text2 - 文本2

Returns:

相似度分值

similarScore

public double similarScore(List<Word> words1,
                           List<Word> words2)

词列表1和词列表2的相似度分值

Specified by:

similarScore in interface Similarity

Parameters:

words1 - 词列表1

words2 - 词列表2

Returns:

相似度分值

scoreImpl

protected abstract double scoreImpl(List<Word> words1,
                                    List<Word> words2)

计算相似度分值

Parameters:

words1 - 词列表1

words2 - 词列表2

Returns:

相似度分值

taggingWeightWithWordFrequency

protected void taggingWeightWithWordFrequency(List<Word> words1,
                                              List<Word> words2)

如果没有指定权重，则默认使用词频来标注词的权重 词频数据怎么来？ 一个词在词列表1中出现了几次，它在词列表1中的权重就是几 一个词在词列表2中出现了几次，它在词列表2中的权重就是几 标注好的权重存储在Word类的weight字段中

Parameters:

words1 - 词列表1

words2 - 词列表2

toFastSearchMap

protected Map<String,Float> toFastSearchMap(List<Word> words)

构造权重快速搜索容器

Parameters:

words - 词列表

Returns:

Map