Package org.apache.pinot.common.datablock

Class ColumnarDataBlock

java.lang.Object

org.apache.pinot.common.datablock.BaseDataBlock

org.apache.pinot.common.datablock.ColumnarDataBlock

All Implemented Interfaces:

DataBlock

public class ColumnarDataBlock
extends BaseDataBlock

Column-wise data table. It stores data in columnar-major format.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pinot.common.datablock.DataBlock

DataBlock.Type

Field Summary

Fields

Modifier and Type	Field	Description
protected int[]	_columnSizeInBytes
protected int[]	_cumulativeColumnOffsetSizeInBytes

Fields inherited from class org.apache.pinot.common.datablock.BaseDataBlock

_dataSchema, _errCodeToExceptionMap, _fixDataSize, _fixedSizeData, _fixedSizeDataBytes, _metadata, _numColumns, _numRows, _stringDictionary, _variableSizeData, _variableSizeDataBytes, HEADER_SIZE

Constructor Summary

Constructors

Constructor	Description
ColumnarDataBlock()
ColumnarDataBlock(int numRows, DataSchema dataSchema, String[] stringDictionary, byte[] fixedSizeDataBytes, byte[] variableSizeDataBytes)
ColumnarDataBlock(ByteBuffer byteBuffer)

Method Summary

Modifier and Type	Method	Description
protected void	computeBlockObjectConstants()
protected int	getDataBlockVersionType()	Return the int serialized form of the data block version and type.
protected int	getOffsetInFixedBuffer(int rowId, int colId)	return the offset in _fixedSizeDataBytes of the row/column ID.
protected int	positionOffsetInVariableBufferAndGetLength(int rowId, int colId)	position the _variableSizeDataBytes to the corresponding row/column ID.
ColumnarDataBlock	toDataOnlyDataTable()
ColumnarDataBlock	toMetadataOnlyDataTable()

Methods inherited from class org.apache.pinot.common.datablock.BaseDataBlock

addException, addException, deserializeStringDictionary, getBigDecimal, getBytes, getDataSchema, getDouble, getDoubleArray, getExceptions, getFloat, getFloatArray, getInt, getIntArray, getLong, getLongArray, getMetadata, getNullRowIds, getNumberOfRows, getString, getStringArray, getVersion, serializeStringDictionary, toBytes, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

_cumulativeColumnOffsetSizeInBytes

protected int[] _cumulativeColumnOffsetSizeInBytes

_columnSizeInBytes

protected int[] _columnSizeInBytes

Constructor Detail

ColumnarDataBlock

public ColumnarDataBlock()

ColumnarDataBlock

public ColumnarDataBlock(int numRows,
                         DataSchema dataSchema,
                         String[] stringDictionary,
                         byte[] fixedSizeDataBytes,
                         byte[] variableSizeDataBytes)

ColumnarDataBlock

public ColumnarDataBlock(ByteBuffer byteBuffer)
                  throws IOException

Throws:

IOException

Method Detail

computeBlockObjectConstants

protected void computeBlockObjectConstants()

getDataBlockVersionType

protected int getDataBlockVersionType()

Description copied from class: BaseDataBlock

Return the int serialized form of the data block version and type.

Specified by:

getDataBlockVersionType in class BaseDataBlock

Returns:

getOffsetInFixedBuffer

protected int getOffsetInFixedBuffer(int rowId,
                                     int colId)

Description copied from class: BaseDataBlock

return the offset in _fixedSizeDataBytes of the row/column ID.

Specified by:

getOffsetInFixedBuffer in class BaseDataBlock

Parameters:

rowId - row ID

colId - column ID

Returns:

the offset in the fixed size buffer for the row/columnID.

positionOffsetInVariableBufferAndGetLength

protected int positionOffsetInVariableBufferAndGetLength(int rowId,
                                                         int colId)

Description copied from class: BaseDataBlock

position the _variableSizeDataBytes to the corresponding row/column ID. and return the length of bytes to extract from the variable size buffer.

Specified by:

positionOffsetInVariableBufferAndGetLength in class BaseDataBlock

Parameters:

rowId - row ID

colId - column ID

Returns:

the length to extract from variable size buffer.

toMetadataOnlyDataTable

public ColumnarDataBlock toMetadataOnlyDataTable()

toDataOnlyDataTable

public ColumnarDataBlock toDataOnlyDataTable()