Package org.apache.pinot.segment.local.utils

Class FixedIntArrayOffHeapIdMap

java.lang.Object

org.apache.pinot.segment.local.realtime.impl.dictionary.BaseOffHeapMutableDictionary

org.apache.pinot.segment.local.utils.FixedIntArrayOffHeapIdMap

All Implemented Interfaces:

Closeable, AutoCloseable, IdMap<FixedIntArray>, IndexReader, MutableDictionary, Dictionary

public class FixedIntArrayOffHeapIdMap
extends BaseOffHeapMutableDictionary
implements IdMap<FixedIntArray>

Implementation of IdMap with FixedIntArray as key. This implementation extends the BaseOffHeapMutableDictionary for code-reuse of off-heap functionality. The dictionary related APIs are not supported.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pinot.segment.spi.index.reader.Dictionary

Dictionary.SortedBatchLookupAlgorithm

Field Summary

Fields inherited from interface org.apache.pinot.segment.spi.index.reader.Dictionary

NULL_VALUE_INDEX

Fields inherited from interface org.apache.pinot.segment.local.utils.IdMap

INVALID_ID

Constructor Summary

Constructors

Constructor	Description
FixedIntArrayOffHeapIdMap(int estimatedCardinality, int maxOverflowHashSize, int numColumns, PinotDataBufferMemoryManager memoryManager, String allocationContext)

Method Summary

Modifier and Type	Method	Description
int	compare(int dictId1, int dictId2)
void	doClose()
protected boolean	equalsValueAt(int dictId, Object value, byte[] serializedValue)
Object	get(int dictId)
int	getAvgValueSize()
BigDecimal	getBigDecimalValue(int dictId)
it.unimi.dsi.fastutil.ints.IntSet	getDictIdsInRange(String lower, String upper, boolean includeLower, boolean includeUpper)
double	getDoubleValue(int dictId)
float	getFloatValue(int dictId)
int	getId(FixedIntArray key)	Returns the id associated with the specified key.
int	getIntValue(int dictId)
FixedIntArray	getKey(int id)	Returns the key associated with the specified id.
long	getLongValue(int dictId)
Comparable	getMaxVal()
Comparable	getMinVal()
Object	getSortedValues()
String	getStringValue(int dictId)
long	getTotalOffHeapMemUsed()
FieldSpec.DataType	getValueType()
int	index(Object value)
int[]	index(Object[] values)
int	indexOf(String stringValue)
int	put(FixedIntArray key)	Puts the specified key into the map.
protected void	setValue(int dictId, Object value, byte[] serializedValue)
int	size()	Returns the current size of the map, zero if the map is empty.

Methods inherited from class org.apache.pinot.segment.local.realtime.impl.dictionary.BaseOffHeapMutableDictionary

close, getDictId, getNumberOfHeapBuffersUsed, getNumberOfOveflowValues, getOffHeapMemUsed, indexValue, init, length, nearestPowerOf2

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Methods inherited from interface org.apache.pinot.segment.spi.index.reader.Dictionary

getByteArrayValue, getBytesValue, getDictIds, getDictIds, getInternal, indexOf, indexOf, indexOf, indexOf, indexOf, indexOf, readBigDecimalValues, readBytesValues, readDoubleValues, readDoubleValues, readFloatValues, readFloatValues, readIntValues, readIntValues, readLongValues, readLongValues, readStringValues

Methods inherited from interface org.apache.pinot.segment.spi.index.mutable.MutableDictionary

insertionIndexOf, isSorted

Constructor Detail

FixedIntArrayOffHeapIdMap

public FixedIntArrayOffHeapIdMap(int estimatedCardinality,
                                 int maxOverflowHashSize,
                                 int numColumns,
                                 PinotDataBufferMemoryManager memoryManager,
                                 String allocationContext)

Method Detail

put

public int put(FixedIntArray key)

Description copied from interface: IdMap

Puts the specified key into the map. The id for the key is auto-generated as follows:

If key does not exist in the map, it is inserted into the map with a new id which is equal to number of elements in the map before the key is inserted. For example, the first key inserted will have id of 0, second will have an id of 1, and so on.

If key already exists in the map, then it keeps its original id.

Specified by:

put in interface IdMap<FixedIntArray>

Parameters:

key - Key to be inserted into the map.

Returns:

Returns the id for the key.

getId

public int getId(FixedIntArray key)

Description copied from interface: IdMap

Returns the id associated with the specified key.

Returns the id of the key if it exists.

Returns IdMap.INVALID_ID if the key does not exist in the map.

Specified by:

getId in interface IdMap<FixedIntArray>

Parameters:

key - Key to get.

Returns:

Id of the key.

getKey

public FixedIntArray getKey(int id)

Description copied from interface: IdMap

Returns the key associated with the specified id.

Returns the id of the key if it exists.

Returns null if the key does not exist in the map.

Specified by:

getKey in interface IdMap<FixedIntArray>

Parameters:

id - id for which to get the key.

Returns:

Key for the id.

size

public int size()

Description copied from interface: IdMap

Returns the current size of the map, zero if the map is empty.

Specified by:

size in interface IdMap<FixedIntArray>

Returns:

Size of the map.

setValue

protected void setValue(int dictId,
                        Object value,
                        byte[] serializedValue)

Specified by:

setValue in class BaseOffHeapMutableDictionary

equalsValueAt

protected boolean equalsValueAt(int dictId,
                                Object value,
                                byte[] serializedValue)

Specified by:

equalsValueAt in class BaseOffHeapMutableDictionary

doClose

public void doClose()
             throws IOException

Specified by:

doClose in class BaseOffHeapMutableDictionary

Throws:

IOException

index

public int index(Object value)

Specified by:

index in interface MutableDictionary

index

public int[] index(Object[] values)

Specified by:

index in interface MutableDictionary

compare

public int compare(int dictId1,
                   int dictId2)

Specified by:

compare in interface Dictionary

getDictIdsInRange

public it.unimi.dsi.fastutil.ints.IntSet getDictIdsInRange(String lower,
                                                           String upper,
                                                           boolean includeLower,
                                                           boolean includeUpper)

Specified by:

getDictIdsInRange in interface Dictionary

getMinVal

public Comparable getMinVal()

Specified by:

getMinVal in interface Dictionary

getMaxVal

public Comparable getMaxVal()

Specified by:

getMaxVal in interface Dictionary

getSortedValues

public Object getSortedValues()

Specified by:

getSortedValues in interface Dictionary

getValueType

public FieldSpec.DataType getValueType()

Specified by:

getValueType in interface Dictionary

indexOf

public int indexOf(String stringValue)

Specified by:

indexOf in interface Dictionary

get

public Object get(int dictId)

Specified by:

get in interface Dictionary

getIntValue

public int getIntValue(int dictId)

Specified by:

getIntValue in interface Dictionary

getLongValue

public long getLongValue(int dictId)

Specified by:

getLongValue in interface Dictionary

getFloatValue

public float getFloatValue(int dictId)

Specified by:

getFloatValue in interface Dictionary

getDoubleValue

public double getDoubleValue(int dictId)

Specified by:

getDoubleValue in interface Dictionary

getBigDecimalValue

public BigDecimal getBigDecimalValue(int dictId)

Specified by:

getBigDecimalValue in interface Dictionary

getStringValue

public String getStringValue(int dictId)

Specified by:

getStringValue in interface Dictionary

getAvgValueSize

public int getAvgValueSize()

Specified by:

getAvgValueSize in class BaseOffHeapMutableDictionary

getTotalOffHeapMemUsed

public long getTotalOffHeapMemUsed()

Specified by:

getTotalOffHeapMemUsed in class BaseOffHeapMutableDictionary