final class OnHeapColumnVector extends WritableColumnVector
A column backed by an in memory JVM array. This stores the NULLs as a byte per value and a java array for the values.
- Alphabetic
- By Inheritance
- OnHeapColumnVector
- WritableColumnVector
- ColumnVector
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new OnHeapColumnVector(capacity: Int, type: DataType)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
appendArray(length: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendBoolean(v: Boolean): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendBooleans(count: Int, v: Boolean): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendByte(v: Byte): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendByteArray(value: Array[Byte], offset: Int, length: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendBytes(length: Int, src: Array[Byte], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendBytes(count: Int, v: Byte): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendDouble(v: Double): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendDoubles(length: Int, src: Array[Double], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendDoubles(count: Int, v: Double): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendFloat(v: Float): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendFloats(length: Int, src: Array[Float], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendFloats(count: Int, v: Float): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendInt(v: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendInts(length: Int, src: Array[Int], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendInts(count: Int, v: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendLong(v: Long): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendLongs(length: Int, src: Array[Long], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendLongs(count: Int, v: Long): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendNotNull(): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendNotNulls(count: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendNull(): Int
Append APIs.
Append APIs. These APIs all behave similarly and will append data to the current vector. It is not valid to mix the put and append APIs. The append APIs are slower and should only be used if the sizes are not known up front. In all these cases, the return value is the rowId for the first appended element.
- Definition Classes
- WritableColumnVector
-
final
def
appendNulls(count: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendShort(v: Short): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendShorts(length: Int, src: Array[Short], offset: Int): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendShorts(count: Int, v: Short): Int
- Definition Classes
- WritableColumnVector
-
final
def
appendStruct(isNull: Boolean): Int
Appends a NULL struct.
Appends a NULL struct. This *has* to be used for structs instead of appendNull() as this recursively appends a NULL to its children. We don't have this logic as the general appendNull implementation to optimize the more common non-struct case.
- Definition Classes
- WritableColumnVector
-
def
arrayData(): WritableColumnVector
- Definition Classes
- WritableColumnVector
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
close(): Unit
- Definition Classes
- OnHeapColumnVector → WritableColumnVector → ColumnVector → AutoCloseable
- Annotations
- @Override()
-
final
def
dataType(): DataType
- Definition Classes
- ColumnVector
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getArray(rowId: Int): ColumnarArray
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getArrayLength(rowId: Int): Int
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
getArrayOffset(rowId: Int): Int
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
getBinary(rowId: Int): Array[Byte]
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getBoolean(rowId: Int): Boolean
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getBooleans(rowId: Int, count: Int): Array[Boolean]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getByte(rowId: Int): Byte
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getBytes(rowId: Int, count: Int): Array[Byte]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getBytesAsUTF8String(rowId: Int, count: Int): UTF8String
Gets the values of bytes from [rowId, rowId + count), as a UTF8String.
Gets the values of bytes from [rowId, rowId + count), as a UTF8String. This method is similar to
int), but can save data copy as UTF8String is used as a pointer.- Attributes
- protected[vectorized]
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
getChild(ordinal: Int): WritableColumnVector
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getDecimal(rowId: Int, precision: Int, scale: Int): Decimal
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getDictId(rowId: Int): Int
Returns the dictionary Id for rowId.
Returns the dictionary Id for rowId. This should only be called when the ColumnVector is dictionaryIds. We have this separate method for dictionaryIds as per SPARK-16928.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
-
def
getDictionaryIds(): WritableColumnVector
Returns the underlying integer column for ids of dictionary.
Returns the underlying integer column for ids of dictionary.
- Definition Classes
- WritableColumnVector
-
def
getDouble(rowId: Int): Double
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getDoubles(rowId: Int, count: Int): Array[Double]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
getElementsAppended(): Int
Returns the elements appended.
Returns the elements appended.
- Definition Classes
- WritableColumnVector
-
def
getFloat(rowId: Int): Float
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getFloats(rowId: Int, count: Int): Array[Float]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getInt(rowId: Int): Int
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
getInterval(arg0: Int): CalendarInterval
- Definition Classes
- ColumnVector
-
def
getInts(rowId: Int, count: Int): Array[Int]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getLong(rowId: Int): Long
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getLongs(rowId: Int, count: Int): Array[Long]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
getMap(rowId: Int): ColumnarMap
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getShort(rowId: Int): Short
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
def
getShorts(rowId: Int, count: Int): Array[Short]
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
getStruct(arg0: Int): ColumnarRow
- Definition Classes
- ColumnVector
-
def
getUTF8String(rowId: Int): UTF8String
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
hasDictionary(): Boolean
Returns true if this column has a dictionary.
Returns true if this column has a dictionary.
- Definition Classes
- WritableColumnVector
-
def
hasNull(): Boolean
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isArray(): Boolean
- Attributes
- protected[vectorized]
- Definition Classes
- WritableColumnVector
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
def
isNullAt(rowId: Int): Boolean
- Definition Classes
- OnHeapColumnVector → ColumnVector
- Annotations
- @Override()
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
numNulls(): Int
- Definition Classes
- WritableColumnVector → ColumnVector
- Annotations
- @Override()
-
def
putArray(rowId: Int, offset: Int, length: Int): Unit
Puts a byte array that already exists in this column.
Puts a byte array that already exists in this column.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putBoolean(rowId: Int, value: Boolean): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putBooleans(rowId: Int, count: Int, value: Boolean): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putByte(rowId: Int, value: Byte): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putByteArray(rowId: Int, value: Array[Byte], offset: Int, length: Int): Int
Sets values from [value + offset, value + offset + count) to the values at rowId.
Sets values from [value + offset, value + offset + count) to the values at rowId.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
final
def
putByteArray(rowId: Int, value: Array[Byte]): Int
- Definition Classes
- WritableColumnVector
-
def
putBytes(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putBytes(rowId: Int, count: Int, value: Byte): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putDecimal(rowId: Int, value: Decimal, precision: Int): Unit
- Definition Classes
- WritableColumnVector
-
def
putDouble(rowId: Int, value: Double): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putDoubles(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be ieee formatted doubles in platform native endian.
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be ieee formatted doubles in platform native endian.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putDoubles(rowId: Int, count: Int, src: Array[Double], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putDoubles(rowId: Int, count: Int, value: Double): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putDoublesLittleEndian(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be ieee formatted doubles in little endian.
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be ieee formatted doubles in little endian.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putFloat(rowId: Int, value: Float): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putFloats(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be ieee formatted floats in platform native endian.
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be ieee formatted floats in platform native endian.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putFloats(rowId: Int, count: Int, src: Array[Float], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putFloats(rowId: Int, count: Int, value: Float): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putFloatsLittleEndian(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be ieee formatted floats in little endian.
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be ieee formatted floats in little endian.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putInt(rowId: Int, value: Int): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putInterval(rowId: Int, value: CalendarInterval): Unit
- Definition Classes
- WritableColumnVector
-
def
putInts(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be 4-byte platform native endian ints.
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be 4-byte platform native endian ints.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putInts(rowId: Int, count: Int, src: Array[Int], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putInts(rowId: Int, count: Int, value: Int): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putIntsLittleEndian(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be 4-byte little endian ints.
Sets values from [src[srcIndex], src[srcIndex + count * 4]) to [rowId, rowId + count) The data in src must be 4-byte little endian ints.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putLong(rowId: Int, value: Long): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putLongs(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be 8-byte platform native endian longs.
Sets values from [src[srcIndex], src[srcIndex + count * 8]) to [rowId, rowId + count) The data in src must be 8-byte platform native endian longs.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putLongs(rowId: Int, count: Int, src: Array[Long], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putLongs(rowId: Int, count: Int, value: Long): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putLongsLittleEndian(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src + srcIndex, src + srcIndex + count * 8) to [rowId, rowId + count) The data in src must be 8-byte little endian longs.
Sets values from [src + srcIndex, src + srcIndex + count * 8) to [rowId, rowId + count) The data in src must be 8-byte little endian longs.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putNotNull(rowId: Int): Unit
Sets null/not null to the value at rowId.
Sets null/not null to the value at rowId.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putNotNulls(rowId: Int, count: Int): Unit
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putNull(rowId: Int): Unit
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putNulls(rowId: Int, count: Int): Unit
Sets null/not null to the values at [rowId, rowId + count).
Sets null/not null to the values at [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putShort(rowId: Int, value: Short): Unit
Sets
valueto the value at rowId.Sets
valueto the value at rowId.- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putShorts(rowId: Int, count: Int, src: Array[Byte], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count * 2]) to [rowId, rowId + count) The data in src must be 2-byte platform native endian shorts.
Sets values from [src[srcIndex], src[srcIndex + count * 2]) to [rowId, rowId + count) The data in src must be 2-byte platform native endian shorts.
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putShorts(rowId: Int, count: Int, src: Array[Short], srcIndex: Int): Unit
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
Sets values from [src[srcIndex], src[srcIndex + count]) to [rowId, rowId + count)
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
putShorts(rowId: Int, count: Int, value: Short): Unit
Sets value to [rowId, rowId + count).
Sets value to [rowId, rowId + count).
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
reserve(requiredCapacity: Int): Unit
- Definition Classes
- WritableColumnVector
-
def
reserveDictionaryIds(capacity: Int): WritableColumnVector
Reserve a integer column for ids of dictionary.
Reserve a integer column for ids of dictionary.
- Definition Classes
- WritableColumnVector
-
def
reserveInternal(newCapacity: Int): Unit
Ensures that there is enough storage to store capacity elements.
Ensures that there is enough storage to store capacity elements. That is, the put() APIs must work for all rowIds < capacity.
- Attributes
- protected[vectorized]
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
reserveNewColumn(capacity: Int, type: DataType): OnHeapColumnVector
Reserve a new column.
Reserve a new column.
- Attributes
- protected[vectorized]
- Definition Classes
- OnHeapColumnVector → WritableColumnVector
- Annotations
- @Override()
-
def
reset(): Unit
Resets this column for writing.
Resets this column for writing. The currently stored values are no longer accessible.
- Definition Classes
- WritableColumnVector
-
def
setDictionary(dictionary: Dictionary): Unit
Update the dictionary.
Update the dictionary.
- Definition Classes
- WritableColumnVector
-
final
def
setIsConstant(): Unit
Marks this column as being constant.
Marks this column as being constant.
- Definition Classes
- WritableColumnVector
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()