Packages

package lore

Lore framework is used for dumping input data of a gpu executor to disk so that it can be replayed in local environment for performance analysis.
When RapidsConf.TAG_LORE_ID_ENABLED is set, during the planning phase we will tag a lore id to each gpu operator. Lore id is guaranteed to be unique within a query, and it's supposed to be same for operators with same plan.
When RapidsConf.LORE_DUMP_IDS is set, during the execution phase we will dump the input data of gpu operators with lore id to disk. The dumped data can be replayed in local environment. The dumped data will reside in RapidsConf.LORE_DUMP_PATH. For more details, please refer to docs/dev/lore.md.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. lore
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class GpuLoreDumpRDD extends RDD[ColumnarBatch] with GpuLoreRDD
  2. trait GpuLoreRDD extends AnyRef
  3. case class GpuLoreReplayExec(idxInParent: Int, parentRootPath: String, hadoopConf: Broadcast[SerializableConfiguration]) extends SparkPlan with LeafExecNode with GpuExec with Product with Serializable
  4. class GpuLoreReplayRDD extends RDD[ColumnarBatch] with GpuLoreRDD
  5. case class LoreDumpRDDInfo(idxInParent: Int, loreOutputInfo: LoreOutputInfo, attrs: Seq[Attribute], hadoopConf: Broadcast[SerializableConfiguration]) extends Product with Serializable
  6. type LoreId = Int
  7. case class LoreOutputInfo(outputLoreId: OutputLoreId, pathStr: String) extends Product with Serializable
  8. case class LoreRDDMeta(numPartitions: Int, outputPartitions: Seq[Int], attrs: Seq[Attribute]) extends Product with Serializable
  9. case class LoreRDDPartitionMeta(numBatches: Int, dataType: Seq[DataType]) extends Product with Serializable
  10. case class LoreReplayPartition(index: Int) extends Partition with Product with Serializable
  11. case class OutputLoreId(loreId: LoreId, partitionIds: Set[Int]) extends Product with Serializable
  12. type OutputLoreIds = Map[LoreId, OutputLoreId]
  13. class SimpleRDD extends RDD[ColumnarBatch]

Value Members

  1. object GpuLore
  2. object OutputLoreId extends Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped