RAPIDS Accelerator for Apache Spark SQL Plugin 24.10.1 API < Back

Packages

package root

Definition Classes
root
package com

Definition Classes
root
package nvidia

Definition Classes
com
package spark

Definition Classes
nvidia
package rapids

Definition Classes
spark
package cudf_utils

Definition Classes
rapids
package delta

Definition Classes
rapids
DeltaProbe
DeltaProvider
NoDeltaProvider
package format

Definition Classes
rapids
package iceberg

Definition Classes
rapids
package lore
Lore framework is used for dumping input data of a gpu executor to disk so that it can be replayed in local environment for performance analysis.
Lore framework is used for dumping input data of a gpu executor to disk so that it can be replayed in local environment for performance analysis.
When RapidsConf.TAG_LORE_ID_ENABLED is set, during the planning phase we will tag a lore id to each gpu operator. Lore id is guaranteed to be unique within a query, and it's supposed to be same for operators with same plan.
When RapidsConf.LORE_DUMP_IDS is set, during the execution phase we will dump the input data of gpu operators with lore id to disk. The dumped data can be replayed in local environment. The dumped data will reside in RapidsConf.LORE_DUMP_PATH. For more details, please refer to docs/dev/lore.md.

Definition Classes
rapids
package python

Definition Classes
rapids
package shims

Definition Classes
rapids
package shuffle

Definition Classes
rapids
package spark320

Definition Classes
rapids
package window

Definition Classes
rapids

p

com.nvidia.spark.rapids

delta

package delta

Ordering

Alphabetic

Visibility

Public
All

Type Members

trait DeltaProbe extends AnyRef
Probe interface to determine which Delta Lake provider to use.
trait DeltaProvider extends AnyRef
Interfaces to avoid accessing the optional Delta Lake jars directly in common code.

Value Members

object DeltaProvider
object NoDeltaProvider extends DeltaProvider

Ungrouped