Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package nvidia
    Definition Classes
    com
  • package spark
    Definition Classes
    nvidia
  • package rapids
    Definition Classes
    spark
  • class RapidsGdsStore extends RapidsBufferStore with Arm

    A buffer store using GPUDirect Storage (GDS).

    A buffer store using GPUDirect Storage (GDS).

    GDS is more efficient when IO is aligned.

    An IO is unaligned if one of the following conditions is true: - The file_offset that was issued in cuFileRead/cuFileWrite is not 4K aligned. - The size that was issued in cuFileRead/cuFileWrite is not 4K aligned. - The devPtr_base that was issued in cuFileRead/cuFileWrite is not 4K aligned. - The devPtr_offset that was issued in cuFileRead/cuFileWrite is not 4K aligned.

    To avoid unaligned IO, when GDS spilling is enabled, the RMM aligned_resource_adapter is used so that large buffers above certain size threshold are allocated with 4K aligned base pointer and size.

    When reading and writing these large buffers through GDS, the size is aligned up to the next 4K boundary. Although the aligned size appears to be out of bound, the extra space needed is held in reserve by the RMM aligned_resource_adapter.

    Definition Classes
    rapids
  • BatchSpiller
  • RapidsBufferBase
  • RapidsGdsBuffer
  • RapidsGdsSingleShotBuffer

class BatchSpiller extends AnyRef

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BatchSpiller
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BatchSpiller()

Type Members

  1. class RapidsGdsBatchedBuffer extends RapidsGdsBuffer

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. def spill(other: RapidsBuffer, deviceBuffer: DeviceMemoryBuffer): RapidsGdsStore.RapidsBufferBase
  16. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  17. def toString(): String
    Definition Classes
    AnyRef → Any
  18. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped