ai.rapids.cudf.nvcomp

Class BatchedLZ4Compressor

java.lang.Object

ai.rapids.cudf.nvcomp.BatchedLZ4Compressor

public class BatchedLZ4Compressor
extends Object

Multi-buffer LZ4 compressor

Constructor Summary

Constructors

Constructor and Description
BatchedLZ4Compressor(long chunkSize, long targetIntermediateBufferSize) Construct a batched LZ4 compressor instance

Method Summary

Modifier and Type	Method and Description
DeviceMemoryBuffer[]	compress(BaseDeviceMemoryBuffer[] origInputs, Cuda.Stream stream) Compress a batch of buffers with LZ4.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchedLZ4Compressor

public BatchedLZ4Compressor(long chunkSize,
                            long targetIntermediateBufferSize)

Construct a batched LZ4 compressor instance

Parameters:

chunkSize - maximum amount of uncompressed data to compress as a single chunk. Inputs larger than this will be compressed in multiple chunks.

targetIntermediateBufferSize - desired maximum size of intermediate device buffers used during compression.

Method Detail

compress

public DeviceMemoryBuffer[] compress(BaseDeviceMemoryBuffer[] origInputs,
                                     Cuda.Stream stream)

Compress a batch of buffers with LZ4. The input buffers will be closed.

Parameters:

origInputs - buffers to compress

stream - CUDA stream to use

Returns:

compressed buffers corresponding to the input buffers