Package org.apache.pinot.common.datatable

Class DataTableImplV4

java.lang.Object

org.apache.pinot.common.datatable.DataTableImplV4

All Implemented Interfaces:

DataTable

@Evolving
public class DataTableImplV4
extends Object
implements DataTable

Datatable V4 Implementation is a wrapper around the Row-based data block.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pinot.common.datatable.DataTable

DataTable.CustomObject, DataTable.MetadataKey, DataTable.MetadataValueType

Field Summary

Fields

Modifier and Type	Field	Description
protected int[]	_columnOffsets
protected DataSchema	_dataSchema
protected Map<Integer,String>	_errCodeToExceptionMap
protected int	_fixDataSize
protected ByteBuffer	_fixedSizeData
protected byte[]	_fixedSizeDataBytes
protected Map<String,String>	_metadata
protected int	_numColumns
protected int	_numRows
protected int	_rowSizeInBytes
protected String[]	_stringDictionary
protected ByteBuffer	_variableSizeData
protected byte[]	_variableSizeDataBytes
protected static int	HEADER_SIZE

Fields inherited from interface org.apache.pinot.common.datatable.DataTable

EXCEPTION_METADATA_KEY

Constructor Summary

Constructors

Constructor	Description
DataTableImplV4()
DataTableImplV4(int numRows, DataSchema dataSchema, String[] stringDictionary, byte[] fixedSizeDataBytes, byte[] variableSizeDataBytes)
DataTableImplV4(ByteBuffer byteBuffer)

Method Summary

Modifier and Type	Method	Description
void	addException(int errCode, String errMsg)
void	addException(ProcessingException processingException)
protected void	computeBlockObjectConstants()
protected String[]	deserializeStringDictionary(ByteBuffer buffer)	Helper method to deserialize dictionary map.
BigDecimal	getBigDecimal(int rowId, int colId)
ByteArray	getBytes(int rowId, int colId)
DataTable.CustomObject	getCustomObject(int rowId, int colId)
DataSchema	getDataSchema()
double	getDouble(int rowId, int colId)
double[]	getDoubleArray(int rowId, int colId)
Map<Integer,String>	getExceptions()
float	getFloat(int rowId, int colId)
float[]	getFloatArray(int rowId, int colId)
int	getInt(int rowId, int colId)
int[]	getIntArray(int rowId, int colId)
long	getLong(int rowId, int colId)
long[]	getLongArray(int rowId, int colId)
Map<String,String>	getMetadata()
org.roaringbitmap.RoaringBitmap	getNullRowIds(int colId)
int	getNumberOfRows()
protected int	getOffsetInFixedBuffer(int rowId, int colId)	return the offset in _fixedSizeDataBytes of the row/column ID.
int	getRowSizeInBytes()
String	getString(int rowId, int colId)
String[]	getStringArray(int rowId, int colId)
int	getVersion()
protected int	positionOffsetInVariableBufferAndGetLength(int rowId, int colId)	position the _variableSizeDataBytes to the corresponding row/column ID.
protected byte[]	serializeStringDictionary()	Helper method to serialize dictionary map.
byte[]	toBytes()
DataTable	toDataOnlyDataTable()
DataTable	toMetadataOnlyDataTable()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

HEADER_SIZE

protected static final int HEADER_SIZE

See Also:

Constant Field Values

_errCodeToExceptionMap

protected Map<Integer,String> _errCodeToExceptionMap

_numRows

protected int _numRows

_numColumns

protected int _numColumns

_fixDataSize

protected int _fixDataSize

_dataSchema

protected DataSchema _dataSchema

_stringDictionary

protected String[] _stringDictionary

_fixedSizeDataBytes

protected byte[] _fixedSizeDataBytes

_fixedSizeData

protected ByteBuffer _fixedSizeData

_variableSizeDataBytes

protected byte[] _variableSizeDataBytes

_variableSizeData

protected ByteBuffer _variableSizeData

_metadata

protected Map<String,String> _metadata

_columnOffsets

protected int[] _columnOffsets

_rowSizeInBytes

protected int _rowSizeInBytes

Constructor Detail

DataTableImplV4

public DataTableImplV4()

DataTableImplV4

public DataTableImplV4(int numRows,
                       DataSchema dataSchema,
                       String[] stringDictionary,
                       byte[] fixedSizeDataBytes,
                       byte[] variableSizeDataBytes)

DataTableImplV4

public DataTableImplV4(ByteBuffer byteBuffer)
                throws IOException

Throws:

IOException

Method Detail

getVersion

public int getVersion()

Specified by:

getVersion in interface DataTable

getMetadata

public Map<String,String> getMetadata()

Specified by:

getMetadata in interface DataTable

getDataSchema

public DataSchema getDataSchema()

Specified by:

getDataSchema in interface DataTable

getNumberOfRows

public int getNumberOfRows()

Specified by:

getNumberOfRows in interface DataTable

getInt

public int getInt(int rowId,
                  int colId)

Specified by:

getInt in interface DataTable

getLong

public long getLong(int rowId,
                    int colId)

Specified by:

getLong in interface DataTable

getFloat

public float getFloat(int rowId,
                      int colId)

Specified by:

getFloat in interface DataTable

getDouble

public double getDouble(int rowId,
                        int colId)

Specified by:

getDouble in interface DataTable

getBigDecimal

public BigDecimal getBigDecimal(int rowId,
                                int colId)

Specified by:

getBigDecimal in interface DataTable

getString

public String getString(int rowId,
                        int colId)

Specified by:

getString in interface DataTable

getBytes

public ByteArray getBytes(int rowId,
                          int colId)

Specified by:

getBytes in interface DataTable

getIntArray

public int[] getIntArray(int rowId,
                         int colId)

Specified by:

getIntArray in interface DataTable

getLongArray

public long[] getLongArray(int rowId,
                           int colId)

Specified by:

getLongArray in interface DataTable

getFloatArray

public float[] getFloatArray(int rowId,
                             int colId)

Specified by:

getFloatArray in interface DataTable

getDoubleArray

public double[] getDoubleArray(int rowId,
                               int colId)

Specified by:

getDoubleArray in interface DataTable

getStringArray

public String[] getStringArray(int rowId,
                               int colId)

Specified by:

getStringArray in interface DataTable

getCustomObject

@Nullable
public DataTable.CustomObject getCustomObject(int rowId,
                                              int colId)

Specified by:

getCustomObject in interface DataTable

getNullRowIds

@Nullable
public org.roaringbitmap.RoaringBitmap getNullRowIds(int colId)

Specified by:

getNullRowIds in interface DataTable

serializeStringDictionary

protected byte[] serializeStringDictionary()
                                    throws IOException

Helper method to serialize dictionary map.

Throws:

IOException

deserializeStringDictionary

protected String[] deserializeStringDictionary(ByteBuffer buffer)
                                        throws IOException

Helper method to deserialize dictionary map.

Throws:

IOException

addException

public void addException(ProcessingException processingException)

Specified by:

addException in interface DataTable

addException

public void addException(int errCode,
                         String errMsg)

Specified by:

addException in interface DataTable

getExceptions

public Map<Integer,String> getExceptions()

Specified by:

getExceptions in interface DataTable

toBytes

public byte[] toBytes()
               throws IOException

Specified by:

toBytes in interface DataTable

Throws:

IOException

computeBlockObjectConstants

protected void computeBlockObjectConstants()

getOffsetInFixedBuffer

protected int getOffsetInFixedBuffer(int rowId,
                                     int colId)

return the offset in _fixedSizeDataBytes of the row/column ID.

Parameters:

rowId - row ID

colId - column ID

Returns:

the offset in the fixed size buffer for the row/columnID.

positionOffsetInVariableBufferAndGetLength

protected int positionOffsetInVariableBufferAndGetLength(int rowId,
                                                         int colId)

position the _variableSizeDataBytes to the corresponding row/column ID. and return the length of bytes to extract from the variable size buffer.

Parameters:

rowId - row ID

colId - column ID

Returns:

the length to extract from variable size buffer.

toMetadataOnlyDataTable

public DataTable toMetadataOnlyDataTable()

Specified by:

toMetadataOnlyDataTable in interface DataTable

toDataOnlyDataTable

public DataTable toDataOnlyDataTable()

Specified by:

toDataOnlyDataTable in interface DataTable

getRowSizeInBytes

public int getRowSizeInBytes()

toString

public String toString()

Overrides:

toString in class Object