Package org.apache.pinot.segment.local.io.writer.impl

Class FixedBitMVEntryDictForwardIndexWriter

java.lang.Object

org.apache.pinot.segment.local.io.writer.impl.FixedBitMVEntryDictForwardIndexWriter

All Implemented Interfaces:

Closeable, AutoCloseable

public class FixedBitMVEntryDictForwardIndexWriter
extends Object
implements Closeable

Bit-compressed dictionary-encoded forward index writer for multi-value columns, where a second level dictionary encoding for multi-value entries (instead of individual values within the entry) are maintained within the forward index. Index layout: - Index header (24 bytes) - ID buffer (stores the multi-value entry id for each doc id) - Offset buffer (stores the start offset of each multi-value entry, followed by end offset of the last value) - Value buffer (stores the individual values) Header layout: - Magic marker (4 bytes) - Version (2 bytes) - Bits per value (1 byte) - Bits per id (1 byte) - Number of unique MV entries (4 bytes) - Number of total values (4 bytes) - Start offset of offset buffer (4 bytes) - Start offset of value buffer (4 bytes)

Field Summary

Fields

Modifier and Type	Field	Description
static int	HEADER_SIZE
static int	MAGIC_MARKER
static short	VERSION

Constructor Summary

Constructors

Constructor	Description
FixedBitMVEntryDictForwardIndexWriter(File file, int numDocs, int numBitsPerValue)

Method Summary

Modifier and Type	Method	Description
void	close()
void	putDictIds(int[] dictIds)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAGIC_MARKER

public static final int MAGIC_MARKER

See Also:

Constant Field Values

VERSION

public static final short VERSION

See Also:

Constant Field Values

HEADER_SIZE

public static final int HEADER_SIZE

See Also:

Constant Field Values

Constructor Detail

FixedBitMVEntryDictForwardIndexWriter

public FixedBitMVEntryDictForwardIndexWriter(File file,
                                             int numDocs,
                                             int numBitsPerValue)

Method Detail

putDictIds

public void putDictIds(int[] dictIds)

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException