package spark
- Alphabetic
- Public
- All
Type Members
-
class
ExclusiveModeGpuDiscoveryPlugin extends ResourceDiscoveryPlugin with Logging
A Spark Resource Discovery Plugin that relies on the Nvidia GPUs being in PROCESS_EXCLUSIVE mode so that it can discover free GPUs.
A Spark Resource Discovery Plugin that relies on the Nvidia GPUs being in PROCESS_EXCLUSIVE mode so that it can discover free GPUs. This plugin iterates through all the GPUs on the node and tries to initialize a CUDA context on each one. When the GPUs are in process exclusive mode this will result in that GPU being assigned to the specific process running this plugin and other executors will not be able to use it.
This plugin can be activated in spark with the configuration:
--conf spark.resources.discoveryPlugin=com.nvidia.spark.ExclusiveModeGpuDiscoveryPlugin -
trait
RapidsUDF extends AnyRef
A RAPIDS accelerated version of a user-defined function (UDF).
-
class
SQLPlugin extends SparkPlugin with Logging
The RAPIDS plugin for Spark.
The RAPIDS plugin for Spark. To enable this plugin, set the config "spark.plugins" to
com.nvidia.spark.SQLPlugin
Value Members
- object RebaseHelper extends Arm