Package org.apache.lucene.analysis.core
package org.apache.lucene.analysis.core
Basic, general-purpose analysis components.
-
ClassesClassDescription"Tokenizes" the entire stream as a single token.Emits the entire input as a single token.Factory for
KeywordTokenizer.A LetterTokenizer is a tokenizer that divides text at non-letters.Factory forLetterTokenizer.Normalizes token text to lower case.Factory forLowerCaseFilter.LowerCaseTokenizer performs the function of LetterTokenizer and LowerCaseFilter together.Factory forLowerCaseTokenizer.Removes stop words from a token stream.Factory forStopFilter.Removes tokens whose types appear in a set of blocked types from a token stream.Factory class forTypeTokenFilter.Normalizes token text to UPPER CASE.Factory forUpperCaseFilter.An Analyzer that usesWhitespaceTokenizer.A WhitespaceTokenizer is a tokenizer that divides text at whitespace.Factory forWhitespaceTokenizer.