Packages

object MetaUtils

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MetaUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val TableIdDefaultValue: Int
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def buildDegenerateTableMeta(batch: ColumnarBatch): TableMeta

    Build a TableMeta message for a degenerate table (zero columns or rows)

    Build a TableMeta message for a degenerate table (zero columns or rows)

    batch

    the degenerate columnar batch which must be compressed or packed

    returns

    heap-based flatbuffer message

  7. def buildTableMeta(fbb: FlatBufferBuilder, bufferMetaOffset: Option[Int], packedMeta: ByteBuffer, numRows: Long): TableMeta

    Build a TableMeta message with a pre-built BufferMeta message

    Build a TableMeta message with a pre-built BufferMeta message

    fbb

    flatbuffer builder that has an already built BufferMeta message

    bufferMetaOffset

    offset where the BufferMeta message was built

    packedMeta

    opaque metadata needed to unpack the table

    numRows

    the number of rows in the table

    returns

    flatbuffer message

  8. def buildTableMeta(tableId: Option[Int], ct: ContiguousTable, codecId: Byte, compressedSize: Long): TableMeta

    Build a TableMeta message from a Table that originated in contiguous memory that has since been compressed.

    Build a TableMeta message from a Table that originated in contiguous memory that has since been compressed.

    tableId

    ID to use for this table

    ct

    contiguous table representing the uncompressed data

    codecId

    identifier of the codec being used, see CodecType

    compressedSize

    compressed data from the uncompressed buffer

    returns

    heap-based flatbuffer message

  9. def buildTableMeta(tableId: Int, bufferSize: Long, packedMeta: ByteBuffer, rowCount: Long): TableMeta
  10. def buildTableMeta(tableId: Int, ct: ContiguousTable): TableMeta

    Build a TableMeta message from a Table in contiguous memory

    Build a TableMeta message from a Table in contiguous memory

    tableId

    the ID to use for this table

    ct

    the contiguous table whose metadata will be encoded in the message

    returns

    heap-based flatbuffer message

  11. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  12. def dropCodecs(tableMeta: TableMeta): TableMeta

    Build a copy of the input TableMeta but ignoring any codecs specified in BufferMeta This is necessary after a decompression, such that batches that are reconstituted have a metadata that indicate they are not compressed.

    Build a copy of the input TableMeta but ignoring any codecs specified in BufferMeta This is necessary after a decompression, such that batches that are reconstituted have a metadata that indicate they are not compressed.

    tableMeta

    - the incoming metadata with codec specifications

    returns

    a TableMeta without codecs

  13. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. def getBatchFromMeta(deviceBuffer: DeviceMemoryBuffer, meta: TableMeta, sparkTypes: Array[DataType]): ColumnarBatch

    Construct a columnar batch from a contiguous device buffer and a TableMeta message describing the schema of the buffer data.

    Construct a columnar batch from a contiguous device buffer and a TableMeta message describing the schema of the buffer data.

    deviceBuffer

    contiguous buffer

    meta

    schema metadata

    sparkTypes

    the spark types that the ColumnarBatch should have.

    returns

    columnar batch that must be closed by the caller

  17. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  18. def getTableFromMeta(deviceBuffer: DeviceMemoryBuffer, meta: TableMeta): Table

    Construct a table from a contiguous device buffer and a TableMeta message describing the schema of the buffer data.

    Construct a table from a contiguous device buffer and a TableMeta message describing the schema of the buffer data.

    deviceBuffer

    contiguous buffer

    meta

    schema metadata

    returns

    table that must be closed by the caller

  19. def getTableMetaNoTable(bufferSize: Long): TableMeta

    Constructs a table metadata buffer from a buffer length without describing any schema for the buffer.

  20. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  21. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  22. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  23. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  24. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  25. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  26. def toString(): String
    Definition Classes
    AnyRef → Any
  27. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped