Package org.apache.pinot.segment.local.segment.creator.impl

Class SegmentDictionaryCreator

java.lang.Object

org.apache.pinot.segment.local.segment.creator.impl.SegmentDictionaryCreator

All Implemented Interfaces:

Closeable, AutoCloseable, IndexCreator

public class SegmentDictionaryCreator
extends Object
implements IndexCreator

The IndexCreator for dictionaries. Although this class implements IndexCreator, it is not intended to be used as a normal IndexCreator. Specifically, neither add(Object, int) or add(Object[], int[]) should be called on this object. In order to make sure these methods are not being called, they throw exceptions in this class. This requirement is a corollary from the fact that the IndexCreator contract assumes the dictionary id can be calculated before calling add methods.

Constructor Summary

Constructors

Constructor	Description
SegmentDictionaryCreator(FieldSpec fieldSpec, File indexDir)
SegmentDictionaryCreator(FieldSpec fieldSpec, File indexDir, boolean useVarLengthDictionary)

Method Summary

Modifier and Type	Method	Description
void	add(Object[] values, int[] dictIds)
void	add(Object value, int dictId)
void	build(Object sortedValues)
void	close()
int	getNumBytesPerEntry()
int[]	indexOfMV(Object value)
int	indexOfSV(Object value)
void	postIndexingCleanup()	Cleans up the no longer needed objects after all the indexing is done to free up some memory.
void	seal()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SegmentDictionaryCreator

public SegmentDictionaryCreator(FieldSpec fieldSpec,
                                File indexDir,
                                boolean useVarLengthDictionary)

SegmentDictionaryCreator

public SegmentDictionaryCreator(FieldSpec fieldSpec,
                                File indexDir)

Method Detail

add

public void add(@Nonnull
                Object value,
                int dictId)
         throws IOException

Specified by:

add in interface IndexCreator

Throws:

IOException

add

public void add(@Nonnull
                Object[] values,
                @Nullable
                int[] dictIds)
         throws IOException

Specified by:

add in interface IndexCreator

Throws:

IOException

build

public void build(Object sortedValues)
           throws IOException

Throws:

IOException

getNumBytesPerEntry

public int getNumBytesPerEntry()

indexOfSV

public int indexOfSV(Object value)

indexOfMV

public int[] indexOfMV(Object value)

postIndexingCleanup

public void postIndexingCleanup()

Cleans up the no longer needed objects after all the indexing is done to free up some memory.

seal

public void seal()

Specified by:

seal in interface IndexCreator

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable