Packages

package rapids

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. trait AdaptiveSparkPlanHelperShim extends AnyRef
  2. case class AvroBatchContext(origChunkedBlocks: LinkedHashMap[Path, ArrayBuffer[DataBlockBase]], schema: SchemaBase, mergedHeader: Header) extends BatchContext with Product with Serializable
  3. case class AvroBlockMeta(header: Header, headerSize: Long, blocks: Seq[BlockInfo]) extends Product with Serializable

    Avro block meta info

    Avro block meta info

    header

    the header of avro file

    blocks

    the total block info of avro file

  4. case class AvroDataBlock(blockInfo: BlockInfo) extends DataBlockBase with Product with Serializable

    avro BlockInfo wrapper

  5. case class AvroExtraInfo() extends ExtraInfo with Product with Serializable

    Extra information

  6. case class AvroFileFilterHandler(hadoopConf: Configuration, options: AvroOptions) extends Logging with Product with Serializable

    A tool to filter Avro blocks

  7. class AvroProviderImpl extends AvroProvider
  8. case class AvroSchemaWrapper(schema: Schema) extends SchemaBase with Product with Serializable

    avro schema wrapper

  9. case class AvroSingleDataBlockInfo(filePath: Path, dataBlock: AvroDataBlock, partitionValues: InternalRow, schema: AvroSchemaWrapper, readSchema: StructType, extraInfo: AvroExtraInfo) extends SingleDataBlockInfo with Product with Serializable
  10. trait BasePad extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with NullIntolerant
  11. class BasicColumnarWriteJobStatsTracker extends ColumnarWriteJobStatsTracker

    Simple ColumnarWriteJobStatsTracker implementation that's serializable, capable of instantiating BasicColumnarWriteTaskStatsTracker on executors and processing the BasicColumnarWriteTaskStats they produce by aggregating the metrics and posting them as DriverMetricUpdates.

  12. case class BasicColumnarWriteTaskStats(numPartitions: Int, numFiles: Int, numBytes: Long, numRows: Long) extends WriteTaskStats with Product with Serializable

    Simple metrics collected during an instance of GpuFileFormatDataWriter.

    Simple metrics collected during an instance of GpuFileFormatDataWriter. These were first introduced in https://github.com/apache/spark/pull/18159 (SPARK-20703).

  13. class BasicColumnarWriteTaskStatsTracker extends ColumnarWriteTaskStatsTracker with Logging

    Simple metrics collected during an instance of GpuFileFormatDataWriter.

    Simple metrics collected during an instance of GpuFileFormatDataWriter. This is the columnar version of org.apache.spark.sql.execution.datasources.BasicWriteTaskStatsTracker.

  14. class BytesInFlightLimiter extends AnyRef
  15. trait ColumnarWriteJobStatsTracker extends Serializable

    A class implementing this trait is basically a collection of parameters that are necessary for instantiating a (derived type of) ColumnarWriteTaskStatsTracker on all executors and then process the statistics produced by them (e.g.

    A class implementing this trait is basically a collection of parameters that are necessary for instantiating a (derived type of) ColumnarWriteTaskStatsTracker on all executors and then process the statistics produced by them (e.g. save them to memory/disk, issue warnings, etc). It is therefore important that such an objects is Serializable, as it will be sent from the driver to all executors.

  16. trait ColumnarWriteTaskStatsTracker extends AnyRef

    A trait for classes that are capable of collecting statistics on columnar data that's being processed by a single write task in GpuFileFormatDataWriter - i.e.

    A trait for classes that are capable of collecting statistics on columnar data that's being processed by a single write task in GpuFileFormatDataWriter - i.e. there should be one instance per executor.

    newPartition event is only triggered if the relation to be written out is partitioned.

  17. abstract class ConvertUTCTimestampExprMetaBase[INPUT <: BinaryExpression] extends BinaryExprMeta[INPUT]
  18. abstract class CudfBinaryArithmetic extends CudfBinaryOperator with NullIntolerant
  19. abstract class CudfBinaryComparison extends CudfBinaryOperator with Predicate
  20. abstract class CudfBinaryMathExpression extends BinaryExpression with CudfBinaryExpression with Serializable with ImplicitCastInputTypes
  21. abstract class CudfBinaryPredicateWithSideEffect extends CudfBinaryOperator with Predicate
  22. abstract class CudfUnaryMathExpression extends GpuUnaryMathExpression with CudfUnaryExpression
  23. class ExecutionPlanCaptureCallback extends QueryExecutionListener

    Used as a part of testing to capture the executed query plan.

  24. trait ExecutionPlanCaptureCallbackBase extends AnyRef
  25. class FromUTCTimestampExprMeta extends ConvertUTCTimestampExprMetaBase[FromUTCTimestamp]
  26. class FromUnixTimeMeta extends UnixTimeExprMeta[FromUnixTime]
  27. case class GpuAbs(child: Expression, failOnError: Boolean) extends GpuUnaryExpression with CudfUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  28. case class GpuAcos(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  29. case class GpuAcoshCompat(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  30. case class GpuAcoshImproved(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  31. case class GpuAdd(left: Expression, right: Expression, failOnError: Boolean) extends GpuAddBase with Product with Serializable
  32. abstract class GpuAddBase extends CudfBinaryArithmetic with Serializable
  33. case class GpuAnd(left: Expression, right: Expression) extends CudfBinaryPredicateWithSideEffect with Product with Serializable
  34. trait GpuArrayBinaryLike extends Expression with GpuComplexTypeMergingExpression with NullIntolerant
  35. case class GpuArrayContains(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with NullIntolerant with Product with Serializable

    Checks if the array (left) has the element (right)

  36. case class GpuArrayExcept(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  37. case class GpuArrayIntersect(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  38. abstract class GpuArrayMax extends GpuUnaryExpression with ImplicitCastInputTypes with Serializable
  39. abstract class GpuArrayMin extends GpuUnaryExpression with ImplicitCastInputTypes with Serializable
  40. case class GpuArrayRemove(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with Product with Serializable
  41. case class GpuArrayRepeat(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with Product with Serializable
  42. case class GpuArrayUnion(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  43. case class GpuArraysOverlap(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  44. case class GpuArraysZip(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  45. case class GpuAsin(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  46. case class GpuAsinhCompat(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  47. case class GpuAsinhImproved(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  48. case class GpuAtan(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  49. case class GpuAtanh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  50. case class GpuAvroMultiFilePartitionReaderFactory(sqlConf: SQLConf, rapidsConf: RapidsConf, broadcastedConf: Broadcast[SerializableConfiguration], dataSchema: StructType, readDataSchema: StructType, partitionSchema: StructType, options: AvroOptions, metrics: Map[String, GpuMetric], filters: Array[Filter], queryUsesInputFile: Boolean) extends MultiFilePartitionReaderFactoryBase with Product with Serializable

    The multi-file partition reader factory for cloud or coalescing reading of avro file format.

  51. class GpuAvroPartitionReader extends FilePartitionReaderBase with GpuAvroReaderBase

    A PartitionReader that reads an AVRO file split on the GPU.

  52. case class GpuAvroPartitionReaderFactory(sqlConf: SQLConf, rapidsConf: RapidsConf, broadcastedConf: Broadcast[SerializableConfiguration], dataSchema: StructType, readDataSchema: StructType, partitionSchema: StructType, avroOptions: AvroOptions, metrics: Map[String, GpuMetric], params: Map[String, String]) extends ShimFilePartitionReaderFactory with Logging with Product with Serializable

    Avro partition reader factory to build columnar reader

  53. trait GpuAvroReaderBase extends Logging

    A trait collecting common methods across the 3 kinds of avro readers

  54. case class GpuAvroScan(sparkSession: SparkSession, fileIndex: PartitioningAwareFileIndex, dataSchema: StructType, readDataSchema: StructType, readPartitionSchema: StructType, options: CaseInsensitiveStringMap, pushedFilters: Array[Filter], rapidsConf: RapidsConf, partitionFilters: Seq[Expression] = Seq.empty, dataFilters: Seq[Expression] = Seq.empty, queryUsesInputFile: Boolean = false) extends FileScan with GpuScan with Product with Serializable
  55. case class GpuBRound(child: Expression, scale: Expression, outputType: DataType) extends GpuRoundBase with Product with Serializable
  56. case class GpuBasicArrayMax(child: Expression) extends GpuArrayMax with Product with Serializable

    ArrayMax without NaN handling

  57. case class GpuBasicArrayMin(child: Expression) extends GpuArrayMin with Product with Serializable

    ArrayMin without Nan handling

  58. case class GpuBitLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  59. case class GpuBitwiseAnd(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  60. case class GpuBitwiseNot(child: Expression) extends GpuUnaryExpression with CudfUnaryExpression with ExpectsInputTypes with Product with Serializable
  61. case class GpuBitwiseOr(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  62. case class GpuBitwiseXor(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  63. class GpuCartesianPartition extends Partition
  64. case class GpuCartesianProductExec(left: SparkPlan, right: SparkPlan, condition: Option[Expression], targetSizeBytes: Long) extends SparkPlan with ShimBinaryExecNode with GpuExec with Product with Serializable
  65. class GpuCartesianRDD extends RDD[ColumnarBatch] with Serializable
  66. case class GpuCbrt(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  67. case class GpuCeil(child: Expression, outputType: DataType) extends CudfUnaryMathExpression with Product with Serializable
  68. case class GpuConcat(children: Seq[Expression]) extends Expression with GpuComplexTypeMergingExpression with Product with Serializable
  69. case class GpuConcatWs(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ImplicitCastInputTypes with Product with Serializable
  70. case class GpuContains(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  71. case class GpuConv(num: Expression, fromBase: Expression, toBase: Expression) extends TernaryExpression with GpuTernaryExpression with Product with Serializable
  72. class GpuConvMeta extends TernaryExprMeta[Conv]
  73. case class GpuCos(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  74. case class GpuCosh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  75. case class GpuCot(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  76. case class GpuCreateArray(children: Seq[Expression], useStringTypeWhenEmpty: Boolean) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  77. case class GpuCreateMap(children: Seq[Expression], useStringTypeWhenEmpty: Boolean) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  78. case class GpuCreateNamedStruct(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  79. case class GpuDataSource(sparkSession: SparkSession, className: String, paths: Seq[String] = Nil, userSpecifiedSchema: Option[StructType] = None, partitionColumns: Seq[String] = Seq.empty, bucketSpec: Option[BucketSpec] = None, options: Map[String, String] = Map.empty, catalogTable: Option[CatalogTable] = None, origProvider: Class[_], gpuFileFormat: ColumnarFileFormat) extends GpuDataSourceBase with Product with Serializable
  80. abstract class GpuDataSourceBase extends Logging

    A truncated version of Spark DataSource that converts to use the GPU version of InsertIntoHadoopFsRelationCommand for FileFormats we support.

    A truncated version of Spark DataSource that converts to use the GPU version of InsertIntoHadoopFsRelationCommand for FileFormats we support. This does not support DataSource V2 writing at this point because at the time of copying, it did not.

  81. trait GpuDataSourceScanExec extends SparkPlan with ShimLeafExecNode with GpuExec

    GPU implementation of Spark's DataSourceScanExec

  82. case class GpuDateAdd(startDate: Expression, days: Expression) extends BinaryExpression with GpuDateMathBase with Product with Serializable
  83. case class GpuDateAddInterval(start: Expression, interval: Expression, timeZoneId: Option[String] = None, ansiEnabled: Boolean = SQLConf.get.ansiEnabled) extends GpuTimeMath with Product with Serializable
  84. case class GpuDateDiff(endDate: Expression, startDate: Expression) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with Product with Serializable
  85. case class GpuDateFormatClass(timestamp: Expression, format: Expression, strfFormat: String, timeZoneId: Option[String] = None) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ImplicitCastInputTypes with Product with Serializable
  86. trait GpuDateMathBase extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes
  87. case class GpuDateSub(startDate: Expression, days: Expression) extends BinaryExpression with GpuDateMathBase with Product with Serializable
  88. trait GpuDateUnaryExpression extends GpuUnaryExpression with ImplicitCastInputTypes
  89. case class GpuDayOfMonth(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  90. case class GpuDayOfWeek(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  91. case class GpuDayOfYear(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  92. case class GpuDecimalDivide(left: Expression, right: Expression, dataType: DecimalType, failOnError: Boolean = SQLConf.get.ansiEnabled) extends Expression with ShimExpression with GpuDecimalDivideBase with Product with Serializable
  93. trait GpuDecimalDivideBase extends Expression with GpuExpression

    A version of Divide specifically for DecimalType that does not force the left and right to be the same type.

    A version of Divide specifically for DecimalType that does not force the left and right to be the same type. This lets us calculate the correct result on a wider range of values without the need for unbounded precision in the processing.

  94. case class GpuDecimalMultiply(left: Expression, right: Expression, dataType: DecimalType, useLongMultiply: Boolean = false, failOnError: Boolean = SQLConf.get.ansiEnabled) extends Expression with ShimExpression with GpuDecimalMultiplyBase with Product with Serializable
  95. trait GpuDecimalMultiplyBase extends Expression with GpuExpression
  96. trait GpuDivModLike extends CudfBinaryArithmetic
  97. case class GpuDivide(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends CudfBinaryArithmetic with GpuDivModLike with Product with Serializable
  98. class GpuDynamicPartitionDataConcurrentWriter extends GpuDynamicPartitionDataSingleWriter

    Dynamic partition writer with concurrent writers, meaning multiple concurrent writers are opened for writing.

    Dynamic partition writer with concurrent writers, meaning multiple concurrent writers are opened for writing.

    The process has the following steps:

    • Step 1: Maintain a map of output writers per each partition columns. Keep all writers opened; Cache the inputted batches by splitting them into sub-groups and each partition holds a list of spillable sub-groups; Find and write the max pending partition data if the total caches exceed the limitation.
    • Step 2: If number of concurrent writers exceeds limit, fall back to sort-based write (GpuDynamicPartitionDataSingleWriter), sort rest of batches on partition. Write batch by batch, and eagerly close the writer when finishing Caller is expected to call writeWithIterator() instead of write() to write records. Note: when fall back to GpuDynamicPartitionDataSingleWriter, the single writer should restore un-closed writers and should handle un-flushed spillable caches.
  99. class GpuDynamicPartitionDataSingleWriter extends GpuFileFormatDataWriter

    Dynamic partition writer with single writer, meaning only one writer is opened at any time for writing, meaning this single function can write to multiple directories (partitions) or files (bucketing).

    Dynamic partition writer with single writer, meaning only one writer is opened at any time for writing, meaning this single function can write to multiple directories (partitions) or files (bucketing). The data to be written are required to be sorted on partition and/or bucket column(s) before writing.

  100. case class GpuElementAt(left: Expression, right: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with Product with Serializable
  101. class GpuEmptyDirectoryDataWriter extends GpuFileFormatDataWriter

    GPU data writer for empty partitions

  102. case class GpuEndsWith(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  103. case class GpuEqualNullSafe(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable
  104. case class GpuEqualTo(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Equal-to.

    The table below shows how the result is calculated for Equal-to. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    Return (lhs.nan && rhs.nan) || result[i]

    +-------------+------------+------------------+---------------+----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | eq | +-------------+------------+------------------+---------------+----+ | t | f | f | r | f | | f | t | f | r | f | | t | t | f | t | t | | f | f | r | r | na | +-------------+------------+------------------+---------------+----+

  105. case class GpuEqualToNoNans(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    This implementation leverages the default implementation of equal-to on the GPU to perform the binary equals comparison.

    This implementation leverages the default implementation of equal-to on the GPU to perform the binary equals comparison. This is used for operations like PivotFirst, where NaN != NaN (unlike most other cases) when pivoting on a float or double column.

  106. case class GpuExp(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  107. case class GpuExpm1(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  108. abstract class GpuFileFormatDataWriter extends DataWriter[ColumnarBatch]

    Abstract class for writing out data in a single Spark task using the GPU.

    Abstract class for writing out data in a single Spark task using the GPU. This is the GPU version of org.apache.spark.sql.execution.datasources.FileFormatDataWriter.

  109. case class GpuFileSourceScanExec(relation: HadoopFsRelation, originalOutput: Seq[Attribute], requiredSchema: StructType, partitionFilters: Seq[Expression], optionalBucketSet: Option[BitSet], optionalNumCoalescedBuckets: Option[Int], dataFilters: Seq[Expression], tableIdentifier: Option[TableIdentifier], disableBucketedScan: Boolean = false, queryUsesInputFile: Boolean = false, alluxioPathsMap: Option[Map[String, String]], requiredPartitionSchema: Option[StructType] = None)(rapidsConf: RapidsConf) extends SparkPlan with GpuDataSourceScanExec with GpuExec with Product with Serializable

    GPU version of Spark's FileSourceScanExec

    GPU version of Spark's FileSourceScanExec

    relation

    The file-based relation to scan.

    originalOutput

    Output attributes of the scan, including data attributes and partition attributes.

    requiredSchema

    Required schema of the underlying relation, excluding partition columns.

    partitionFilters

    Predicates to use for partition pruning.

    optionalBucketSet

    Bucket ids for bucket pruning.

    optionalNumCoalescedBuckets

    Number of coalesced buckets.

    dataFilters

    Filters on non-partition columns.

    tableIdentifier

    identifier for the table in the metastore.

    disableBucketedScan

    Disable bucketed scan based on physical query plan.

    queryUsesInputFile

    This is a parameter to easily allow turning it off in GpuTransitionOverrides if InputFileName, InputFileBlockStart, or InputFileBlockLength are used

    alluxioPathsMap

    Map containing mapping of DFS scheme to Alluxio scheme

    rapidsConf

    Rapids conf

  110. case class GpuFlattenArray(child: Expression) extends GpuUnaryExpression with NullIntolerant with Product with Serializable
  111. case class GpuFloatArrayMax(child: Expression) extends GpuArrayMax with Product with Serializable

    ArrayMax for FloatType and DoubleType to handle Nans.

    ArrayMax for FloatType and DoubleType to handle Nans.

    In Spark, Nan is the max float value, however in cuDF, the calculation involving Nan is undefined. We design a workaround method here to match the Spark's behaviour. The high level idea is that, we firstly check if each list contains Nan. If it is, the max value is Nan, else we use the cuDF kernel to calculate the max value.

  112. case class GpuFloatArrayMin(child: Expression) extends GpuArrayMin with Product with Serializable

    ArrayMin for FloatType and DoubleType to handle Nans.

    ArrayMin for FloatType and DoubleType to handle Nans.

    In Spark, Nan is the max float value, however in cuDF, the calculation involving Nan is undefined. We design a workaround method here to match the Spark's behaviour. The high level idea is: if one list contains only Nans or nulls then if the list contains Nan then return Nan else return null else replace all Nans with nulls; use cuDF kernel to find the min value

  113. case class GpuFloor(child: Expression, outputType: DataType) extends CudfUnaryMathExpression with Product with Serializable
  114. case class GpuFormatNumber(x: Expression, d: Expression) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  115. case class GpuFromUTCTimestamp(timestamp: Expression, timezone: Expression, zoneId: ZoneId) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  116. case class GpuFromUnixTime(sec: Expression, format: Expression, strfFormat: String, colConverter: Option[(ColumnView) ⇒ ColumnVector], timeZoneId: Option[String]) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ImplicitCastInputTypes with Product with Serializable
  117. case class GpuGetArrayItem(child: Expression, ordinal: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with ShimGetArrayItem with Product with Serializable

    Returns the field at ordinal in the Array child.

    Returns the field at ordinal in the Array child.

    We need to do type checking here as ordinal expression maybe unresolved.

  118. case class GpuGetArrayStructFields(child: Expression, field: StructField, ordinal: Int, numFields: Int, containsNull: Boolean) extends GpuUnaryExpression with ShimGetArrayStructFields with NullIntolerant with Product with Serializable

    For a child whose data type is an array of structs, extracts the ordinal-th fields of all array elements, and returns them as a new array.

    For a child whose data type is an array of structs, extracts the ordinal-th fields of all array elements, and returns them as a new array.

    No need to do type checking since it is handled by 'ExtractValue'.

  119. class GpuGetArrayStructFieldsMeta extends UnaryExprMeta[GetArrayStructFields]
  120. case class GpuGetMapValue(child: Expression, key: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  121. case class GpuGetStructField(child: Expression, ordinal: Int, name: Option[String] = None) extends UnaryExpression with ShimUnaryExpression with GpuExpression with ShimGetStructField with NullIntolerant with Product with Serializable
  122. case class GpuGetTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  123. case class GpuGreaterThan(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for greater-than.

    The table below shows how the result is calculated for greater-than. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return (lhs.nan && !lhs.nan) || result[i]

    +-------------+------------+-----------------+---------------+----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | gt | +-------------+------------+-----------------+---------------+----+ | t | f | f | t | t | | f | t | f | r | f | | t | t | f | r | f | | f | f | r | r | na | +-------------+------------+-----------------+---------------+----+

  124. case class GpuGreaterThanOrEqual(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Greater-than-Eq.

    The table below shows how the result is calculated for Greater-than-Eq. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return lhs.isNan || result[i]

    +-------------+------------+-----------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | gte | +-------------+------------+-----------------+---------------+-----+ | t | f | f | t | t | | f | t | f | r | f | | t | t | f | t | t | | f | f | r | r | NA | +-------------+------------+-----------------+---------------+-----+

  125. case class GpuGreatest(children: Seq[Expression]) extends Expression with GpuGreatestLeastBase with Product with Serializable
  126. trait GpuGreatestLeastBase extends Expression with ComplexTypeMergingExpression with GpuExpression with ShimExpression
  127. abstract class GpuHashExpression extends Expression with GpuExpression with ShimExpression
  128. case class GpuHour(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  129. case class GpuHypot(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  130. case class GpuInMemoryTableScanExec(attributes: Seq[Attribute], predicates: Seq[Expression], relation: InMemoryRelation) extends SparkPlan with ShimLeafExecNode with GpuExec with Product with Serializable
  131. case class GpuInitCap(child: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  132. case class GpuInputFileBlockLength() extends GpuLeafExpression with Product with Serializable

    Returns the length of the block being read, or -1 if not available.

    Returns the length of the block being read, or -1 if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  133. case class GpuInputFileBlockStart() extends GpuLeafExpression with Product with Serializable

    Returns the start offset of the block being read, or -1 if not available.

    Returns the start offset of the block being read, or -1 if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  134. case class GpuInputFileName() extends GpuLeafExpression with Product with Serializable

    Returns the name of the file being read, or empty string if not available.

    Returns the name of the file being read, or empty string if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  135. case class GpuInsertIntoHadoopFsRelationCommand(outputPath: Path, staticPartitions: TablePartitionSpec, ifPartitionNotExists: Boolean, partitionColumns: Seq[Attribute], bucketSpec: Option[BucketSpec], fileFormat: ColumnarFileFormat, options: Map[String, String], query: LogicalPlan, mode: SaveMode, catalogTable: Option[CatalogTable], fileIndex: Option[FileIndex], outputColumnNames: Seq[String], useStableSort: Boolean, concurrentWriterPartitionFlushSize: Long) extends LogicalPlan with GpuDataWritingCommand with Product with Serializable
  136. case class GpuIntegralDivide(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuIntegralDivideParent with Product with Serializable
  137. abstract class GpuIntegralDivideParent extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  138. case class GpuJsonToStructs(schema: DataType, options: Map[String, String], child: Expression, enableMixedTypesAsString: Boolean, timeZoneId: Option[String] = None) extends GpuUnaryExpression with TimeZoneAwareExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  139. case class GpuLastDay(startDate: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  140. case class GpuLeast(children: Seq[Expression]) extends Expression with GpuGreatestLeastBase with Product with Serializable
  141. case class GpuLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  142. case class GpuLessThan(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Less-than.

    The table below shows how the result is calculated for Less-than. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return !lhs.nan && rhs.nan || result[i]

    +-------------+------------+-----------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | lt | +-------------+------------+-----------------+---------------+-----+ | t | f | f | r | f | | f | t | f | t | t | | t | t | f | r | f | | f | f | r | r | NA | +-------------+------------+-----------------+---------------+-----+

  143. case class GpuLessThanOrEqual(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Less-than-Eq.

    The table below shows how the result is calculated for Less-than-Eq. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case, return rhs.nan || result[i]

    +-------------+------------+------------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | lte | +-------------+------------+------------------+---------------+-----+ | t | f | f | r | f | | f | t | f | t | t | | t | t | f | t | t | | f | f | r | r | NA | +-------------+------------+------------------+---------------+-----+

  144. case class GpuLike(left: Expression, right: Expression, escapeChar: Char) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  145. case class GpuLog(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  146. case class GpuLogarithm(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  147. case class GpuLower(child: Expression) extends GpuUnaryString2StringExpression with Product with Serializable
  148. case class GpuMapConcat(children: Seq[Expression]) extends Expression with GpuComplexTypeMergingExpression with Product with Serializable
  149. case class GpuMapEntries(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  150. case class GpuMapKeys(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  151. case class GpuMapValues(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  152. case class GpuMd5(child: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  153. case class GpuMicrosToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  154. case class GpuMillisToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  155. case class GpuMinute(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  156. case class GpuMonth(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  157. class GpuMultiFileAvroPartitionReader extends MultiFileCoalescingPartitionReaderBase with GpuAvroReaderBase

    A PartitionReader that can read multiple AVRO files up to the certain size.

    A PartitionReader that can read multiple AVRO files up to the certain size. It will coalesce small files together and copy the block data in a separate thread pool to speed up processing the small files before sending down to the GPU.

  158. class GpuMultiFileCloudAvroPartitionReader extends MultiFileCloudPartitionReaderBase with MultiFileReaderFunctions with GpuAvroReaderBase

    A PartitionReader that can read multiple AVRO files in parallel.

    A PartitionReader that can read multiple AVRO files in parallel. This is most efficient running in a cloud environment where the I/O of reading is slow.

    When reading a file, it

    • seeks to the start position of the first block located in this partition.
    • next, parses the meta and sync, rewrites the meta and sync, and copies the data to a batch buffer per block, until reaching the last one of the current partition.
    • sends batches to GPU at last.
  159. case class GpuMultiply(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends CudfBinaryArithmetic with Product with Serializable
  160. case class GpuMurmur3Hash(children: Seq[Expression], seed: Int) extends GpuHashExpression with Product with Serializable
  161. case class GpuNormalizeNaNAndZero(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  162. case class GpuNot(child: Expression) extends GpuUnaryExpression with CudfUnaryExpression with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  163. trait GpuNumberToTimestampUnaryExpression extends GpuUnaryExpression
  164. case class GpuOctetLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  165. case class GpuOr(left: Expression, right: Expression) extends CudfBinaryPredicateWithSideEffect with Product with Serializable
  166. class GpuOrcFileFormat extends ColumnarFileFormat with Logging
  167. class GpuOrcWriter extends ColumnarOutputWriter
  168. case class GpuParseUrl(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  169. class GpuPartitionwiseSampledRDD extends PartitionwiseSampledRDD[ColumnarBatch, ColumnarBatch]
  170. case class GpuPmod(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuPmodBase with Product with Serializable
  171. abstract class GpuPmodBase extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  172. class GpuPoissonSampler extends PoissonSampler[ColumnarBatch]
  173. case class GpuPow(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  174. case class GpuPreciseTimestampConversion(child: Expression, fromType: DataType, toType: DataType) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable

    Expression used internally to convert the TimestampType to Long and back without losing precision, i.e.

    Expression used internally to convert the TimestampType to Long and back without losing precision, i.e. in microseconds. Used in time windowing.

  175. case class GpuQuarter(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  176. case class GpuRLike(left: Expression, right: Expression, pattern: String) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  177. class GpuRLikeMeta extends BinaryExprMeta[RLike]
  178. case class GpuRaiseError(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  179. class GpuReadAvroFileFormat extends AvroFileFormat with GpuReadFileFormatWithMetrics

    A FileFormat that allows reading Avro files with the GPU.

  180. case class GpuRegExpExtract(subject: Expression, regexp: Expression, idx: Expression)(cudfRegexPattern: String) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  181. case class GpuRegExpExtractAll(str: Expression, regexp: Expression, idx: Expression)(cudfRegexPattern: String) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  182. class GpuRegExpExtractAllMeta extends TernaryExprMeta[RegExpExtractAll]
  183. class GpuRegExpExtractMeta extends TernaryExprMeta[RegExpExtract]
  184. case class GpuRegExpReplace(srcExpr: Expression, searchExpr: Expression, replaceExpr: Expression)(javaRegexpPattern: String, cudfRegexPattern: String, cudfReplacementString: String, searchList: Option[Seq[String]], replaceOpt: Option[GpuRegExpReplaceOpt]) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with HasGpuStringReplace with Product with Serializable
  185. case class GpuRegExpReplaceWithBackref(child: Expression, searchExpr: Expression, replaceExpr: Expression)(javaRegexpPattern: String, cudfRegexPattern: String, cudfReplacementString: String) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  186. abstract class GpuRegExpTernaryBase extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar
  187. case class GpuRemainder(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuRemainderBase with Product with Serializable
  188. abstract class GpuRemainderBase extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  189. case class GpuReverse(child: Expression) extends GpuUnaryExpression with Product with Serializable
  190. case class GpuRint(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  191. case class GpuRound(child: Expression, scale: Expression, outputType: DataType) extends GpuRoundBase with Product with Serializable
  192. abstract class GpuRoundBase extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Serializable with ImplicitCastInputTypes
  193. case class GpuRowBasedScalaUDF(sparkFunc: AnyRef, dataType: DataType, children: Seq[Expression], inputEncoders: Seq[Option[ExpressionEncoder[_]]], outputEncoder: Option[ExpressionEncoder[_]], udfName: Option[String], nullable: Boolean, udfDeterministic: Boolean) extends Expression with GpuRowBasedUserDefinedFunction with Product with Serializable
  194. case class GpuScalaUDF(function: RapidsUDF, dataType: DataType, children: Seq[Expression], udfName: Option[String], nullable: Boolean, udfDeterministic: Boolean) extends Expression with GpuUserDefinedFunction with Product with Serializable
  195. case class GpuScalarSubquery(plan: BaseSubqueryExec, exprId: ExprId) extends ExecSubqueryExpression with GpuExpression with ShimExpression with Product with Serializable

    GPU placeholder of ScalarSubquery, which returns the scalar result with columnarEval method.

    GPU placeholder of ScalarSubquery, which returns the scalar result with columnarEval method. This placeholder is to make ScalarSubquery working as a GPUExpression to cooperate other GPU overrides.

  196. case class GpuSecond(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  197. case class GpuSecondsToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  198. case class GpuSequence(start: Expression, stop: Expression, stepOpt: Option[Expression], timeZoneId: Option[String] = None) extends Expression with TimeZoneAwareExpression with GpuExpression with ShimExpression with Product with Serializable
  199. class GpuSequenceMeta extends ExprMeta[Sequence]
  200. class GpuSerializableBatch extends Serializable with AutoCloseable
    Annotations
    @SerialVersionUID()
  201. trait GpuShiftBase extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes
  202. case class GpuShiftLeft(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  203. case class GpuShiftRight(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  204. case class GpuShiftRightUnsigned(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  205. abstract class GpuShuffleBlockResolverBase extends ShuffleBlockResolver with Logging
  206. class GpuShuffleDependency[K, V, C] extends ShuffleDependency[K, V, C]
  207. class GpuShuffleEnv extends Logging
  208. class GpuShuffleHandle[K, V] extends BaseShuffleHandle[K, V, V]
  209. case class GpuSignum(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  210. case class GpuSin(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  211. class GpuSingleDirectoryDataWriter extends GpuFileFormatDataWriter

    Writes data to a single directory (used for non-dynamic-partition writes).

  212. case class GpuSinh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  213. case class GpuSize(child: Expression, legacySizeOfNull: Boolean) extends GpuUnaryExpression with Product with Serializable
  214. case class GpuSortArray(base: Expression, ascendingOrder: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ExpectsInputTypes with Product with Serializable
  215. case class GpuSqrt(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  216. case class GpuStartsWith(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  217. case class GpuStringInstr(str: Expression, substr: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  218. case class GpuStringLPad(str: Expression, len: Expression, pad: Expression) extends TernaryExpression with BasePad with Product with Serializable
  219. case class GpuStringLocate(substr: Expression, col: Expression, start: Expression) extends TernaryExpression with GpuTernaryExpressionArgsScalarAnyScalar with ImplicitCastInputTypes with Product with Serializable
  220. case class GpuStringRPad(str: Expression, len: Expression, pad: Expression) extends TernaryExpression with BasePad with Product with Serializable
  221. case class GpuStringRepeat(input: Expression, repeatTimes: Expression) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  222. case class GpuStringReplace(srcExpr: Expression, searchExpr: Expression, replaceExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with HasGpuStringReplace with Product with Serializable
  223. case class GpuStringSplit(str: Expression, regex: Expression, limit: Expression, pattern: String, isRegExp: Boolean) extends TernaryExpression with GpuTernaryExpression with ImplicitCastInputTypes with Product with Serializable
  224. class GpuStringSplitMeta extends StringSplitRegExpMeta[StringSplit]
  225. case class GpuStringToMap(strExpr: Expression, pairDelimExpr: Expression, keyValueDelimExpr: Expression, pairDelim: String, isPairDelimRegExp: Boolean, keyValueDelim: String, isKeyValueDelimRegExp: Boolean) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  226. class GpuStringToMapMeta extends StringSplitRegExpMeta[StringToMap]
  227. case class GpuStringTranslate(srcExpr: Expression, fromExpr: Expression, toExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with Product with Serializable
  228. case class GpuStringTrim(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  229. case class GpuStringTrimLeft(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  230. case class GpuStringTrimRight(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  231. case class GpuStructsToJson(options: Map[String, String], child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with Product with Serializable
  232. class GpuStructsToJsonMeta extends UnaryExprMeta[StructsToJson]
  233. case class GpuSubstring(str: Expression, pos: Expression, len: Expression) extends TernaryExpression with GpuTernaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  234. case class GpuSubstringIndex(strExpr: Expression, regexp: String, ignoredDelimExpr: Expression, ignoredCountExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with Product with Serializable
  235. case class GpuSubtract(left: Expression, right: Expression, failOnError: Boolean) extends GpuSubtractBase with Product with Serializable
  236. abstract class GpuSubtractBase extends CudfBinaryArithmetic with Serializable
  237. case class GpuTan(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  238. case class GpuTanh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  239. class GpuTaskMetrics extends Serializable
  240. abstract class GpuTimeMath extends BinaryExpression with ShimBinaryExpression with GpuExpression with TimeZoneAwareExpression with ExpectsInputTypes with Serializable
  241. trait GpuTimeUnaryExpression extends GpuUnaryExpression with TimeZoneAwareExpression with ImplicitCastInputTypes with NullIntolerant
  242. case class GpuToDegrees(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  243. case class GpuToRadians(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  244. abstract class GpuToTimestamp extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ExpectsInputTypes

    A direct conversion of Spark's ToTimestamp class which converts time to UNIX timestamp by first converting to microseconds and then dividing by the downScaleFactor

  245. case class GpuToUTCTimestamp(timestamp: Expression, timezone: Expression, zoneId: ZoneId) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  246. case class GpuToUnixTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  247. abstract class GpuUnaryMathExpression extends GpuUnaryExpression with Serializable with ImplicitCastInputTypes
  248. case class GpuUnaryMinus(child: Expression, failOnError: Boolean) extends GpuUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  249. case class GpuUnaryPositive(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  250. abstract class GpuUnaryString2StringExpression extends GpuUnaryExpression with ExpectsInputTypes
  251. case class GpuUnixTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  252. case class GpuUpper(child: Expression) extends GpuUnaryString2StringExpression with Product with Serializable
  253. case class GpuWeekDay(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  254. class GpuWriteJobDescription extends Serializable

    A shared job description for all the GPU write tasks.

    A shared job description for all the GPU write tasks. This is the GPU version of org.apache.spark.sql.execution.datasources.WriteJobDescription.

  255. class GpuWriteJobStatsTracker extends BasicColumnarWriteJobStatsTracker

    Simple ColumnarWriteJobStatsTracker implementation that's serializable, capable of instantiating GpuWriteTaskStatsTracker on executors and processing the WriteTaskStats they produce by aggregating the metrics and posting them as DriverMetricUpdates.

  256. class GpuWriteTaskStatsTracker extends BasicColumnarWriteTaskStatsTracker

    ColumnarWriteTaskStatsTracker implementation that produces WriteTaskStats and tracks writing times per task.

  257. case class GpuWriterBucketSpec(bucketIdExpression: Expression, bucketFileNamePrefix: (Int) ⇒ String) extends Product with Serializable

    Bucketing specification for all the write tasks.

    Bucketing specification for all the write tasks. This is the GPU version of org.apache.spark.sql.execution.datasources.WriterBucketSpec

    bucketIdExpression

    Expression to calculate bucket id based on bucket column(s).

    bucketFileNamePrefix

    Prefix of output file name based on bucket id.

  258. case class GpuXxHash64(children: Seq[Expression], seed: Long) extends GpuHashExpression with Product with Serializable
  259. case class GpuYear(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  260. trait HasGpuStringReplace extends AnyRef
  261. class InMemoryTableScanMeta extends SparkPlanMeta[InMemoryTableScanExec]
  262. class JsonDeviceDataSource extends DataSource
  263. class NanoSecondAccumulator extends AccumulatorV2[Long, NanoTime]
  264. case class NanoTime(value: Long) extends Product with Serializable
  265. case class ParseFormatMeta(separator: Option[Char], isTimestamp: Boolean, validRegex: String) extends Product with Serializable
  266. class RapidsCachingReader[K, C] extends ShuffleReader[K, C] with Logging
  267. class RapidsCachingWriter[K, V] extends ShuffleWriter[K, V] with Logging
  268. class RapidsDiskBlockManager extends AnyRef

    Maps logical blocks to local disk locations.

  269. class RapidsShuffleInternalManagerBase extends ShuffleManager with RapidsShuffleHeartbeatHandler with Logging

    A shuffle manager optimized for the RAPIDS Plugin For Apache Spark.

    A shuffle manager optimized for the RAPIDS Plugin For Apache Spark.

    Note

    This is an internal class to obtain access to the private ShuffleManager and SortShuffleManager classes. When configuring Apache Spark to use the RAPIDS shuffle manager,

  270. abstract class RapidsShuffleThreadedReaderBase[K, C] extends ShuffleReader[K, C] with Logging
  271. abstract class RapidsShuffleThreadedWriterBase[K, V] extends ShuffleWriter[K, V] with RapidsShuffleWriterShimHelper with Logging
  272. trait RapidsShuffleWriterShimHelper extends AnyRef
  273. case class RegexReplace(search: String, replace: String) extends Product with Serializable
  274. class ShimmedExecutionPlanCaptureCallbackImpl extends ExecutionPlanCaptureCallbackBase

    Note that the name is prefixed with "Shimmed" such that wildcard rules under unshimmed-common-from-spark311.txt don't get confused and pick this class to be un-shimmed.

  275. class ShuffleHandleWithMetrics[K, V, C] extends BaseShuffleHandle[K, V, C]
  276. trait ShuffleMetricsUpdater extends AnyRef
  277. abstract class StringSplitRegExpMeta[INPUT <: TernaryExpression] extends TernaryExprMeta[INPUT]
  278. class SubstringIndexMeta extends TernaryExprMeta[SubstringIndex]
  279. case class TempSpillBufferId extends RapidsBufferId with Product with Serializable
  280. class ThreadSafeShuffleWriteMetricsReporter extends ShuffleWriteMetrics

    The ShuffleWriteMetricsReporter is based on accumulators, which are not thread safe.

    The ShuffleWriteMetricsReporter is based on accumulators, which are not thread safe. This class is a thin wrapper that adds synchronization, since these metrics will be written by multiple threads.

  281. sealed trait TimeParserPolicy extends Serializable
  282. class ToUTCTimestampExprMeta extends ConvertUTCTimestampExprMetaBase[ToUTCTimestamp]
  283. abstract class UnixTimeExprMeta[A <: BinaryExpression with TimeZoneAwareExpression] extends BinaryExprMeta[A]

Value Members

  1. object AddOverflowChecks
  2. object BasicColumnarWriteJobStatsTracker extends Serializable
  3. object CorrectedTimeParserPolicy extends TimeParserPolicy
  4. object CudfRegexp
  5. object DecimalDivideChecks
  6. object DecimalMultiplyChecks
  7. object ExceptionTimeParserPolicy extends TimeParserPolicy
  8. object ExecutionPlanCaptureCallback extends ExecutionPlanCaptureCallbackBase
  9. object ExternalSource extends Logging

    The subclass of AvroProvider imports spark-avro classes.

    The subclass of AvroProvider imports spark-avro classes. This file should not imports spark-avro classes because class not found exception may throw if spark-avro does not exist at runtime. Details see: https://github.com/NVIDIA/spark-rapids/issues/5648

  10. object GpuAnsi
  11. object GpuArrayMax extends Serializable
  12. object GpuArrayMin extends Serializable
  13. object GpuAvroScan extends Serializable
  14. object GpuCreateMap extends Serializable
  15. object GpuDataSourceBase extends Logging
  16. object GpuDataSourceScanExec extends Serializable
  17. object GpuDivModLike
  18. object GpuElementAtMeta
  19. object GpuFileFormatDataWriter
  20. object GpuFileFormatWriter extends Logging

    A helper object for writing columnar data out to a location.

  21. object GpuFileSourceScanExec extends Serializable
  22. object GpuFloorCeil
  23. object GpuHypot extends Serializable
  24. object GpuJsonReadCommon

    This is a utility method intended to provide common functionality between JsonToStructs and ScanJson

  25. object GpuLogarithm extends Serializable
  26. object GpuMurmur3Hash extends Serializable
  27. object GpuOrcFileFormat extends Logging
  28. object GpuParseUrl extends Serializable
  29. object GpuReadAvroFileFormat extends Serializable
  30. object GpuRegExpUtils
  31. object GpuScalaUDF extends Serializable
  32. object GpuScalaUDFMeta
  33. object GpuSequenceUtil
  34. object GpuShuffleEnv extends Logging
  35. object GpuStringInstr extends Serializable
  36. object GpuSubstringIndex extends Serializable
  37. object GpuTaskMetrics extends Logging with Serializable

    Provides task level metrics

  38. object GpuToTimestamp
  39. object GpuV1WriteUtils
  40. object GpuWriteJobStatsTracker extends Serializable
  41. object InputFileUtils
  42. object LegacyTimeParserPolicy extends TimeParserPolicy
  43. object PCBSSchemaHelper
  44. object RapidsPrivateUtil
  45. object RapidsShuffleInternalManagerBase extends Logging
  46. object ShiftHelper
  47. object SubtractOverflowChecks
  48. object TempSpillBufferId extends Serializable
  49. object TimeZoneDB

Ungrouped