Package org.apache.jackrabbit.oak.plugins.index.lucene.util

Class CRTokenizer

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.apache.lucene.analysis.util.CharTokenizer

org.apache.jackrabbit.oak.plugins.index.lucene.util.CRTokenizer

All Implemented Interfaces:

Closeable, AutoCloseable

public class CRTokenizer
extends CharTokenizer

A CharTokenizer dividing tokens at \n. This should be deprecated if / once LUCENE-5833 fix gets included in the Lucene version we ship.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

AttributeSource.AttributeFactory, AttributeSource.State

Constructor Summary

Constructors

Constructor	Description
CRTokenizer(Version matchVersion, Reader input)

Method Summary

Methods inherited from class org.apache.lucene.analysis.util.CharTokenizer

end, incrementToken, reset

Methods inherited from class org.apache.lucene.analysis.Tokenizer

close, setReader

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Constructor Details

CRTokenizer

public CRTokenizer(Version matchVersion,
 Reader input)