org.apache.jackrabbit.oak.plugins.index.lucene.util

Class OakWordTokenFilter

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.TokenFilter

org.apache.jackrabbit.oak.plugins.index.lucene.util.CompoundWordTokenFilterBase

org.apache.jackrabbit.oak.plugins.index.lucene.util.OakWordTokenFilter

All Implemented Interfaces:

Closeable, AutoCloseable

public class OakWordTokenFilter
extends CompoundWordTokenFilterBase

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.jackrabbit.oak.plugins.index.lucene.util.CompoundWordTokenFilterBase

CompoundWordTokenFilterBase.CompoundToken

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

Field Summary

Fields inherited from class org.apache.jackrabbit.oak.plugins.index.lucene.util.CompoundWordTokenFilterBase

DEFAULT_MAX_SUBWORD_SIZE, DEFAULT_MIN_SUBWORD_SIZE, DEFAULT_MIN_WORD_SIZE, dictionary, maxSubwordSize, minSubwordSize, minWordSize, offsetAtt, onlyLongestMatch, termAtt, tokens

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

Constructors

Constructor and Description
OakWordTokenFilter(org.apache.lucene.util.Version version, org.apache.lucene.analysis.TokenStream in)
OakWordTokenFilter(org.apache.lucene.util.Version version, org.apache.lucene.analysis.TokenStream in, char[] separators)

Method Summary

Modifier and Type	Method and Description
protected void	decompose() Decomposes the current CompoundWordTokenFilterBase.termAtt and places CompoundWordTokenFilterBase.CompoundToken instances in the CompoundWordTokenFilterBase.tokens list.

Methods inherited from class org.apache.jackrabbit.oak.plugins.index.lucene.util.CompoundWordTokenFilterBase

incrementToken, reset

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close, end

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

OakWordTokenFilter

public OakWordTokenFilter(org.apache.lucene.util.Version version,
                          org.apache.lucene.analysis.TokenStream in,
                          char[] separators)

OakWordTokenFilter

public OakWordTokenFilter(org.apache.lucene.util.Version version,
                          org.apache.lucene.analysis.TokenStream in)

Method Detail

decompose

protected void decompose()

Description copied from class: CompoundWordTokenFilterBase

Decomposes the current CompoundWordTokenFilterBase.termAtt and places CompoundWordTokenFilterBase.CompoundToken instances in the CompoundWordTokenFilterBase.tokens list. The original token may not be placed in the list, as it is automatically passed through this filter.

Specified by:

decompose in class CompoundWordTokenFilterBase