Packages

c

com.nvidia.spark.rapids

RapidsHostColumnBuilder

final class RapidsHostColumnBuilder extends AutoCloseable

This is a copy of the cudf HostColumnVector.ColumnBuilder class. Moving this here to allow for iterating on host memory oom handling.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RapidsHostColumnBuilder
  2. AutoCloseable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RapidsHostColumnBuilder(dataType: DataType, estimatedRows: Long)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def append(value: Array[Byte], srcOffset: Int, length: Int): RapidsHostColumnBuilder

    Append multiple non-null byte values.

  5. def append(value: String): RapidsHostColumnBuilder
  6. def append(unscaledVal: BigInteger): RapidsHostColumnBuilder
  7. def append(value: BigDecimal): RapidsHostColumnBuilder
  8. final def append(value: Boolean): RapidsHostColumnBuilder
  9. final def append(value: Double): RapidsHostColumnBuilder
  10. final def append(value: Float): RapidsHostColumnBuilder
  11. final def append(value: Long): RapidsHostColumnBuilder
  12. final def append(value: Int): RapidsHostColumnBuilder
  13. final def append(value: Short): RapidsHostColumnBuilder
  14. final def append(value: Byte): RapidsHostColumnBuilder
  15. def appendByteList(value: Array[Byte], srcOffset: Int, length: Int): RapidsHostColumnBuilder

    Appends bytes to a LIST of INT8/UINT8

  16. def appendByteList(value: Array[Byte]): RapidsHostColumnBuilder

    Appends byte to a LIST of INT8/UINT8

  17. def appendDecimal128(binary: Array[Byte]): RapidsHostColumnBuilder

    Accepts a byte array containing the two's-complement representation of the unscaled value, which is in big-endian byte-order.

    Accepts a byte array containing the two's-complement representation of the unscaled value, which is in big-endian byte-order. Then, transforms it into the representation of cuDF Decimal128 for appending. This method is more efficient than append(BigInteger unscaledVal) if we can directly access the two's-complement representation of a BigDecimal without encoding via the method toByteArray.

  18. def appendLists(inputLists: <repeated...>[List]): RapidsHostColumnBuilder
    Annotations
    @SuppressWarnings()
  19. final def appendNull(): RapidsHostColumnBuilder
  20. def appendStructValues(inputList: <repeated...>[StructData]): RapidsHostColumnBuilder
  21. def appendStructValues(inputList: List[StructData]): RapidsHostColumnBuilder
  22. def appendUTF8String(value: Array[Byte], srcOffset: Int, length: Int): RapidsHostColumnBuilder
  23. def appendUTF8String(value: Array[Byte]): RapidsHostColumnBuilder
  24. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  25. def build(): HostColumnVector
  26. final def buildAndPutOnDevice(): ColumnVector

    Finish and create the immutable ColumnVector, copied to the device.

  27. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  28. def close(): Unit
    Definition Classes
    RapidsHostColumnBuilder → AutoCloseable
    Annotations
    @Override()
  29. def endList(): RapidsHostColumnBuilder

    If you want to build up a list column you can get builder.getChild(0) and append to than, then when you are done call endList and everything that was appended to that builder will now be in the next list.

    If you want to build up a list column you can get builder.getChild(0) and append to than, then when you are done call endList and everything that was appended to that builder will now be in the next list. Do not start to append to the child and then append a null to this without ending the list first or you might not get the results that you expected.

    returns

    this for chaining.

  30. def endStruct(): RapidsHostColumnBuilder

    If you want to build up a struct column you can get each child builder.getChild(N) and append to all of them, then when you are done call endStruct to update this builder.

    If you want to build up a struct column you can get each child builder.getChild(N) and append to all of them, then when you are done call endStruct to update this builder. Do not start to append to the child and then append a null to this without ending the struct first or you might not get the results that you expected.

    returns

    this for chaining.

  31. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  32. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  33. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  34. def getChild(index: Int): RapidsHostColumnBuilder
  35. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  36. def getCurrentIndex(): Int
  37. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  38. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  39. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  40. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  41. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  42. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  43. def toString(): String
    Definition Classes
    RapidsHostColumnBuilder → AnyRef → Any
    Annotations
    @Override()
  44. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  46. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Deprecated Value Members

  1. def getCurrentByteIndex(): Int
    Annotations
    @Deprecated
    Deprecated
  2. def incrCurrentIndex(): Unit
    Annotations
    @Deprecated
    Deprecated

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped