RAPIDS Accelerator for Apache Spark SQL Plugin 24.10.1 API < Back

Packages

package root

Definition Classes
root
package com

Definition Classes
root
package nvidia

Definition Classes
com
package spark

Definition Classes
nvidia
package rapids

Definition Classes
spark
package cudf_utils

Definition Classes
rapids
package delta

Definition Classes
rapids
package format

Definition Classes
rapids
package iceberg

Definition Classes
rapids
package data
package parquet
package spark
IcebergProvider
IcebergProviderImpl
package lore
Lore framework is used for dumping input data of a gpu executor to disk so that it can be replayed in local environment for performance analysis.
Lore framework is used for dumping input data of a gpu executor to disk so that it can be replayed in local environment for performance analysis.
When RapidsConf.TAG_LORE_ID_ENABLED is set, during the planning phase we will tag a lore id to each gpu operator. Lore id is guaranteed to be unique within a query, and it's supposed to be same for operators with same plan.
When RapidsConf.LORE_DUMP_IDS is set, during the execution phase we will dump the input data of gpu operators with lore id to disk. The dumped data can be replayed in local environment. The dumped data will reside in RapidsConf.LORE_DUMP_PATH. For more details, please refer to docs/dev/lore.md.

Definition Classes
rapids
package python

Definition Classes
rapids
package shims

Definition Classes
rapids
package shuffle

Definition Classes
rapids
package spark320

Definition Classes
rapids
package window

Definition Classes
rapids

p

com.nvidia.spark.rapids

iceberg

package iceberg

Ordering

Alphabetic

Visibility

Public
All

Type Members

trait IcebergProvider extends AnyRef
Interfaces to avoid accessing the optional Apache Iceberg jars directly in common code.
class IcebergProviderImpl extends IcebergProvider

Value Members

object IcebergProvider

Ungrouped