org.apache.druid.segment.nested

Class GlobalDictionaryEncodedFieldColumnWriter<T>

java.lang.Object

org.apache.druid.segment.nested.GlobalDictionaryEncodedFieldColumnWriter<T>

Direct Known Subclasses:

DoubleFieldColumnWriter, LongFieldColumnWriter, StringFieldColumnWriter, VariantLiteralFieldColumnWriter

public abstract class GlobalDictionaryEncodedFieldColumnWriter<T>
extends Object

Base class for writer of global dictionary encoded nested literal columns for NestedDataColumnSerializer. NestedDataColumnSerializer while processing the 'raw' nested data will call addValue(int, Object) for all literal writers, which for this type of writer entails building a local dictionary to map into to the global dictionary (localDictionary) and writes this unsorted localId to an intermediate integer column, intermediateValueWriter. When processing the 'raw' value column is complete, the writeTo(int, FileSmoosher) method will sort the local ids and write them out to a local sorted dictionary, iterate over intermediateValueWriter swapping the unsorted local ids with the sorted ids and writing to the compressed id column writer encodedValueSerializer building the bitmap indexes along the way.

Field Summary

Fields

Modifier and Type	Field and Description
protected String	columnName
protected int	cursorPosition
protected SingleValueColumnarIntsSerializer	encodedValueSerializer
protected String	fieldName
protected int	flags
protected GlobalDictionaryIdLookup	globalDictionaryIdLookup
protected IndexSpec	indexSpec
protected FixedIndexedIntWriter	intermediateValueWriter
protected LocalDimensionDictionary	localDictionary
protected SegmentWriteOutMedium	segmentWriteOutMedium
protected DictionaryEncodedColumnPartSerde.VERSION	version

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	GlobalDictionaryEncodedFieldColumnWriter(String columnName, String fieldName, SegmentWriteOutMedium segmentWriteOutMedium, IndexSpec indexSpec, GlobalDictionaryIdLookup globalDictionaryIdLookup)

Method Summary

Modifier and Type	Method and Description
void	addValue(int row, Object val) Add a value to the unsorted local dictionary and write to an intermediate column
void	open() Open the writer so that addValue(int, Object) can be called
void	writeLongAndDoubleColumnLength(WritableByteChannel channel, int longLength, int doubleLength)
void	writeTo(int finalRowCount, FileSmoosher smoosher)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

segmentWriteOutMedium

protected final SegmentWriteOutMedium segmentWriteOutMedium

columnName

protected final String columnName

fieldName

protected final String fieldName

indexSpec

protected final IndexSpec indexSpec

globalDictionaryIdLookup

protected final GlobalDictionaryIdLookup globalDictionaryIdLookup

localDictionary

protected final LocalDimensionDictionary localDictionary

intermediateValueWriter

protected FixedIndexedIntWriter intermediateValueWriter

flags

protected int flags

version

protected DictionaryEncodedColumnPartSerde.VERSION version

encodedValueSerializer

protected SingleValueColumnarIntsSerializer encodedValueSerializer

cursorPosition

protected int cursorPosition

Constructor Detail

GlobalDictionaryEncodedFieldColumnWriter

protected GlobalDictionaryEncodedFieldColumnWriter(String columnName,
                                                   String fieldName,
                                                   SegmentWriteOutMedium segmentWriteOutMedium,
                                                   IndexSpec indexSpec,
                                                   GlobalDictionaryIdLookup globalDictionaryIdLookup)

Method Detail

open

public void open()
          throws IOException

Open the writer so that addValue(int, Object) can be called

Throws:

IOException

addValue

public void addValue(int row,
                     Object val)
              throws IOException

Add a value to the unsorted local dictionary and write to an intermediate column

Throws:

IOException

writeTo

public void writeTo(int finalRowCount,
                    FileSmoosher smoosher)
             throws IOException

Throws:

IOException

writeLongAndDoubleColumnLength

public void writeLongAndDoubleColumnLength(WritableByteChannel channel,
                                           int longLength,
                                           int doubleLength)
                                    throws IOException

Throws:

IOException