Packages

c

com.nvidia.spark.rapids

BatchedNvcompZSTDCompressor

class BatchedNvcompZSTDCompressor extends BatchedTableCompressor

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BatchedNvcompZSTDCompressor
  2. BatchedTableCompressor
  3. Logging
  4. AutoCloseable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BatchedNvcompZSTDCompressor(maxBatchMemorySize: Long, codecConfigs: TableCompressionCodecConfig, stream: Stream)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def addTableToCompress(contigTable: ContiguousTable): Unit

    Add a contiguous table to be batch-compressed.

    Add a contiguous table to be batch-compressed. Ownership of the table is transferred to the batch compressor which is responsible for closing the table.

    contigTable

    the contiguous table to be compressed

    Definition Classes
    BatchedTableCompressor
  5. def addTables(contigTable: Array[ContiguousTable]): Unit

    Add an array of contiguous tables to be compressed.

    Add an array of contiguous tables to be compressed. The tables will be closed by the batch compressor.

    contigTable

    contiguous tables to compress

    Definition Classes
    BatchedTableCompressor
  6. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  8. def close(): Unit

    Must be closed to release the resources owned by the batch compressor

    Must be closed to release the resources owned by the batch compressor

    Definition Classes
    BatchedTableCompressor → AutoCloseable
  9. def compress(tables: Array[ContiguousTable], stream: Stream): Array[CompressedTable]

    Batch-compress contiguous tables

    Batch-compress contiguous tables

    tables

    contiguous tables to compress

    stream

    CUDA stream to use

    returns

    compressed tables. Table IDs in the TableMeta should be set to 0.

    Attributes
    protected
    Definition Classes
    BatchedNvcompZSTDCompressorBatchedTableCompressor
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. def finish(): Array[CompressedTable]

    This must be called after all tables to be compressed have been added to retrieve the compression results.

    This must be called after all tables to be compressed have been added to retrieve the compression results.

    returns

    compressed tables

    Definition Classes
    BatchedTableCompressor
    Note

    the table IDs in the TableMeta of all tables will be set to zero

  14. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  16. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  17. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  18. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  19. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  20. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  21. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  22. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  23. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  24. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  25. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  26. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  27. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  28. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  29. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  30. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  31. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  32. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  33. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  34. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  35. def resizeOversizedOutputs(tables: Array[CompressedTable]): Array[CompressedTable]

    Reallocates and copies data for oversized compressed data buffers due to inaccurate estimates of the compressed output size.

    Reallocates and copies data for oversized compressed data buffers due to inaccurate estimates of the compressed output size. If the buffer is already the appropriate size then no copy is performed.

    tables

    compressed tables to resize

    returns

    right-sized compressed tables

    Attributes
    protected
    Definition Classes
    BatchedTableCompressor
    Note

    This method takes ownership of the tables and is responsible for closing them.

  36. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  37. def toString(): String
    Definition Classes
    AnyRef → Any
  38. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  39. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  40. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from BatchedTableCompressor

Inherited from Logging

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped