org.apache.solr.analysis
Class SmartChineseWordTokenFilterFactory

java.lang.Object
  org.apache.solr.analysis.BaseTokenFilterFactory
      org.apache.solr.analysis.SmartChineseWordTokenFilterFactory

All Implemented Interfaces:

org.apache.solr.analysis.TokenFilterFactory

public class SmartChineseWordTokenFilterFactory
extends org.apache.solr.analysis.BaseTokenFilterFactory

Factory for the SmartChineseAnalyzer WordTokenFilter

Note: this class will currently emit tokens for punctuation. So you should either add a WordDelimiterFilter after to remove these (with concatenate off), or use the SmartChinese stoplist with a StopFilterFactory via: words="org/apache/lucene/analysis/cn/smart/stopwords.txt"

WARNING: This API is experimental and might change in incompatible ways in the next release.

Field Summary

protected Map<String,String>	args
protected Version	luceneMatchVersion

Fields inherited from class org.apache.solr.analysis.BaseTokenFilterFactory

log

Constructor Summary

SmartChineseWordTokenFilterFactory()

Method Summary

protected void	assureMatchVersion()
TokenFilter	create(TokenStream input)
Map<String,String>	getArgs()
protected boolean	getBoolean(String arg0, boolean arg1)
protected boolean	getBoolean(String arg0, boolean arg1, boolean arg2)
protected int	getInt(String arg0)
protected int	getInt(String arg0, int arg1)
protected int	getInt(String arg0, int arg1, boolean arg2)
protected CharArraySet	getSnowballWordSet(org.apache.solr.common.ResourceLoader arg0, String arg1, boolean arg2)
protected CharArraySet	getWordSet(org.apache.solr.common.ResourceLoader arg0, String arg1, boolean arg2)
void	init(Map<String,String> arg0)
protected void	warnDeprecated(String arg0)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.solr.analysis.TokenFilterFactory

getArgs, init

Field Detail

args

protected Map<String,String> args

luceneMatchVersion

protected Version luceneMatchVersion

Constructor Detail

SmartChineseWordTokenFilterFactory

public SmartChineseWordTokenFilterFactory()

Method Detail

create

public TokenFilter create(TokenStream input)

init

public void init(Map<String,String> arg0)

getArgs

public Map<String,String> getArgs()

assureMatchVersion

protected final void assureMatchVersion()

warnDeprecated

protected final void warnDeprecated(String arg0)

getInt

protected int getInt(String arg0)

getInt

protected int getInt(String arg0,
                     int arg1)

getInt

protected int getInt(String arg0,
                     int arg1,
                     boolean arg2)

getBoolean

protected boolean getBoolean(String arg0,
                             boolean arg1)

getBoolean

protected boolean getBoolean(String arg0,
                             boolean arg1,
                             boolean arg2)

getWordSet

protected CharArraySet getWordSet(org.apache.solr.common.ResourceLoader arg0,
                                  String arg1,
                                  boolean arg2)
                           throws IOException

Throws:

IOException

getSnowballWordSet

protected CharArraySet getSnowballWordSet(org.apache.solr.common.ResourceLoader arg0,
                                          String arg1,
                                          boolean arg2)
                                   throws IOException

Throws:

IOException