t

com.nvidia.spark.rapids.shuffle

RapidsShuffleFetchHandler

trait RapidsShuffleFetchHandler extends AnyRef

trait used by client consumers (RapidsShuffleIterator) to gather what the expected number of batches (Tables) is, and the ids for each table as they are received.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RapidsShuffleFetchHandler
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def batchReceived(handle: RapidsBufferHandle): Boolean

    Called when a buffer is received and has been handed off to the catalog.

    Called when a buffer is received and has been handed off to the catalog.

    returns

    a boolean that lets the caller know the batch was accepted (true), or rejected (false), in which case the caller should dispose of the batch.

  2. abstract def getTaskIds: Array[Long]

    Called to get the task attempt ids that this shuffle handler is for.

  3. abstract def start(expectedBatches: Int): Unit

    After a response for shuffle metadata is received, the expected number of columnar batches is communicated back to the caller via this method.

    After a response for shuffle metadata is received, the expected number of columnar batches is communicated back to the caller via this method.

    expectedBatches

    - number of columnar batches

  4. abstract def transferError(errorMessage: String, throwable: Throwable = null): Unit

    Called when the transport layer is not able to handle a fetch error for metadata or buffer fetches.

    Called when the transport layer is not able to handle a fetch error for metadata or buffer fetches.

    errorMessage

    - a string containing an error message

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  16. def toString(): String
    Definition Classes
    AnyRef → Any
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped