ai.rapids.cudf

Class DeviceMemoryBuffer

java.lang.Object

ai.rapids.cudf.MemoryBuffer

ai.rapids.cudf.BaseDeviceMemoryBuffer

ai.rapids.cudf.DeviceMemoryBuffer

All Implemented Interfaces:

AutoCloseable

public class DeviceMemoryBuffer
extends BaseDeviceMemoryBuffer

This class represents data in some form on the GPU. Closing this object will effectively release the memory held by the buffer. Note that because of pooling in RMM or reference counting if a buffer is sliced it may not actually result in the memory being released.

Nested Class Summary

Nested classes/interfaces inherited from class ai.rapids.cudf.MemoryBuffer

MemoryBuffer.MemoryBufferCleaner

Field Summary

Fields inherited from class ai.rapids.cudf.MemoryBuffer

address, cleaner, closed, id, length, refCount

Method Summary

Modifier and Type	Method and Description
static DeviceMemoryBuffer	allocate(long bytes) Allocate memory for use on the GPU.
static DeviceMemoryBuffer	allocate(long bytes, Cuda.Stream stream) Allocate memory for use on the GPU.
DeviceMemoryBuffer	slice(long offset, long len) Slice off a part of the device buffer.

Methods inherited from class ai.rapids.cudf.BaseDeviceMemoryBuffer

copyFromDeviceBufferAsync, copyFromHostBuffer, copyFromHostBuffer, copyFromHostBuffer, copyFromHostBuffer, copyFromHostBuffer, copyFromHostBufferAsync, copyFromHostBufferAsync, sliceWithCopy

Methods inherited from class ai.rapids.cudf.MemoryBuffer

addressOutOfBoundsCheck, close, copyFromMemoryBuffer, copyFromMemoryBufferAsync, getAddress, getLength, incRefCount, noWarnLeakExpected, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

allocate

public static DeviceMemoryBuffer allocate(long bytes)

Allocate memory for use on the GPU. You must close it when done.

Parameters:

bytes - size in bytes to allocate

Returns:

the buffer

allocate

public static DeviceMemoryBuffer allocate(long bytes,
                                          Cuda.Stream stream)

Allocate memory for use on the GPU. You must close it when done.

Parameters:

bytes - size in bytes to allocate

stream - The stream in which to synchronize this command

Returns:

the buffer

slice

public final DeviceMemoryBuffer slice(long offset,
                                      long len)

Slice off a part of the device buffer. Note that this is a zero copy operation and all slices must be closed along with the original buffer before the memory is released to RMM. So use this with some caution.

Specified by:

slice in class MemoryBuffer

Parameters:

offset - where to start the slice at.

len - how many bytes to slice

Returns:

a device buffer that will need to be closed independently from this buffer.