Uses of Class
org.apache.lucene.analysis.TokenFilter

Packages that use TokenFilter

Package	Description
org.apache.lucene.analysis
org.apache.lucene.analysis.core
org.apache.lucene.analysis.en
org.apache.lucene.analysis.hunspell
org.apache.lucene.analysis.miscellaneous
org.apache.lucene.analysis.ngram
org.apache.lucene.analysis.shingle
org.apache.lucene.analysis.standard
org.apache.lucene.analysis.synonym
org.apache.lucene.search.highlight
org.apache.lucene.search.suggest.analyzing
org.apache.lucene.search.suggest.document

Uses of TokenFilter in org.apache.lucene.analysis

Subclasses of TokenFilter in org.apache.lucene.analysis

Modifier and Type	Class	Description
class	CachingTokenFilter	This class can be used if the token attributes of a TokenStream are intended to be consumed more than once.
class	FilteringTokenFilter	Abstract base class for TokenFilters that may remove tokens.
class	GraphTokenFilter	An abstract TokenFilter that exposes its input stream as a graph Call GraphTokenFilter.incrementBaseToken() to move the root of the graph to the next position in the TokenStream, GraphTokenFilter.incrementGraphToken() to move along the current graph, and GraphTokenFilter.incrementGraph() to reset to the next graph based at the current root.
class	LowerCaseFilter	Normalizes token text to lower case.
class	StopFilter	Removes stop words from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.core

Subclasses of TokenFilter in org.apache.lucene.analysis.core

Modifier and Type	Class	Description
class	FlattenGraphFilter	Converts an incoming graph token stream, such as one from SynonymGraphFilter, into a flat form so that all nodes form a single linear chain with no side paths.

Uses of TokenFilter in org.apache.lucene.analysis.en

Subclasses of TokenFilter in org.apache.lucene.analysis.en

Modifier and Type	Class	Description
class	EnglishPossessiveFilter	TokenFilter that removes possessives (trailing 's) from words.
class	PorterStemFilter	Transforms the token stream as per the Porter stemming algorithm.

Uses of TokenFilter in org.apache.lucene.analysis.hunspell

Subclasses of TokenFilter in org.apache.lucene.analysis.hunspell

Modifier and Type	Class	Description
class	HunspellStemFilter	TokenFilter that uses hunspell affix rules and words to stem tokens.

Uses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Subclasses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Modifier and Type	Class	Description
class	DeDuplicatingTokenFilter	Inspects token streams for duplicate sequences of tokens.
class	KeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
class	SetKeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.

Uses of TokenFilter in org.apache.lucene.analysis.ngram

Subclasses of TokenFilter in org.apache.lucene.analysis.ngram

Modifier and Type	Class	Description
class	EdgeNGramTokenFilter	Tokenizes the given token into n-grams of given size(s).

Uses of TokenFilter in org.apache.lucene.analysis.shingle

Subclasses of TokenFilter in org.apache.lucene.analysis.shingle

Modifier and Type	Class	Description
class	FixedShingleFilter	A FixedShingleFilter constructs shingles (token n-grams) from a token stream.
class	ShingleFilter	A ShingleFilter constructs shingles (token n-grams) from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.standard

Subclasses of TokenFilter in org.apache.lucene.analysis.standard

Modifier and Type	Class	Description
class	ClassicFilter	Normalizes tokens extracted with ClassicTokenizer.

Uses of TokenFilter in org.apache.lucene.analysis.synonym

Subclasses of TokenFilter in org.apache.lucene.analysis.synonym

Modifier and Type	Class	Description
class	SynonymFilter	Deprecated. Use SynonymGraphFilter instead, but be sure to also use FlattenGraphFilter at index time (not at search time) as well.
class	SynonymGraphFilter	Applies single- or multi-token synonyms from a SynonymMap to an incoming TokenStream, producing a fully correct graph output.

Uses of TokenFilter in org.apache.lucene.search.highlight

Subclasses of TokenFilter in org.apache.lucene.search.highlight

Modifier and Type	Class	Description
class	OffsetLimitTokenFilter	This TokenFilter limits the number of tokens while indexing by adding up the current offset.

Uses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Subclasses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Modifier and Type	Class	Description
class	SuggestStopFilter	Like StopFilter except it will not remove the last token if that token was not followed by some token separator.

Uses of TokenFilter in org.apache.lucene.search.suggest.document

Subclasses of TokenFilter in org.apache.lucene.search.suggest.document

Modifier and Type	Class	Description
class	CompletionTokenStream	A ConcatenateGraphFilter but we can set the payload and provide access to config options.