Packages

package rapids

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. trait AdaptiveSparkPlanHelperShim extends AnyRef
  2. case class AvroBatchContext(origChunkedBlocks: LinkedHashMap[Path, ArrayBuffer[DataBlockBase]], schema: SchemaBase, mergedHeader: Header) extends BatchContext with Product with Serializable
  3. case class AvroBlockMeta(header: Header, headerSize: Long, blocks: Seq[BlockInfo]) extends Product with Serializable

    Avro block meta info

    Avro block meta info

    header

    the header of avro file

    blocks

    the total block info of avro file

  4. case class AvroDataBlock(blockInfo: BlockInfo) extends DataBlockBase with Product with Serializable

    avro BlockInfo wrapper

  5. case class AvroExtraInfo() extends ExtraInfo with Product with Serializable

    Extra information

  6. case class AvroFileFilterHandler(hadoopConf: Configuration, options: AvroOptions) extends Logging with Product with Serializable

    A tool to filter Avro blocks

  7. class AvroProviderImpl extends AvroProvider
  8. case class AvroSchemaWrapper(schema: Schema) extends SchemaBase with Product with Serializable

    avro schema wrapper

  9. case class AvroSingleDataBlockInfo(filePath: Path, dataBlock: AvroDataBlock, partitionValues: InternalRow, schema: AvroSchemaWrapper, readSchema: StructType, extraInfo: AvroExtraInfo) extends SingleDataBlockInfo with Product with Serializable
  10. trait BasePad extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with NullIntolerant
  11. class BasicColumnarWriteJobStatsTracker extends ColumnarWriteJobStatsTracker

    Simple ColumnarWriteJobStatsTracker implementation that's serializable, capable of instantiating BasicColumnarWriteTaskStatsTracker on executors and processing the BasicColumnarWriteTaskStats they produce by aggregating the metrics and posting them as DriverMetricUpdates.

  12. case class BasicColumnarWriteTaskStats(numPartitions: Int, numFiles: Int, numBytes: Long, numRows: Long) extends WriteTaskStats with Product with Serializable

    Simple metrics collected during an instance of GpuFileFormatDataWriter.

    Simple metrics collected during an instance of GpuFileFormatDataWriter. These were first introduced in https://github.com/apache/spark/pull/18159 (SPARK-20703).

  13. class BasicColumnarWriteTaskStatsTracker extends ColumnarWriteTaskStatsTracker with Logging

    Simple metrics collected during an instance of GpuFileFormatDataWriter.

    Simple metrics collected during an instance of GpuFileFormatDataWriter. This is the columnar version of org.apache.spark.sql.execution.datasources.BasicWriteTaskStatsTracker.

  14. class BytesInFlightLimiter extends AnyRef
  15. trait ColumnarWriteJobStatsTracker extends Serializable

    A class implementing this trait is basically a collection of parameters that are necessary for instantiating a (derived type of) ColumnarWriteTaskStatsTracker on all executors and then process the statistics produced by them (e.g.

    A class implementing this trait is basically a collection of parameters that are necessary for instantiating a (derived type of) ColumnarWriteTaskStatsTracker on all executors and then process the statistics produced by them (e.g. save them to memory/disk, issue warnings, etc). It is therefore important that such an objects is Serializable, as it will be sent from the driver to all executors.

  16. trait ColumnarWriteTaskStatsTracker extends AnyRef

    A trait for classes that are capable of collecting statistics on columnar data that's being processed by a single write task in GpuFileFormatDataWriter - i.e.

    A trait for classes that are capable of collecting statistics on columnar data that's being processed by a single write task in GpuFileFormatDataWriter - i.e. there should be one instance per executor.

    newPartition event is only triggered if the relation to be written out is partitioned.

  17. abstract class ConvertUTCTimestampExprMetaBase[INPUT <: BinaryExpression] extends BinaryExprMeta[INPUT]
  18. abstract class CudfBinaryArithmetic extends CudfBinaryOperator with NullIntolerant
  19. abstract class CudfBinaryComparison extends CudfBinaryOperator with Predicate
  20. abstract class CudfBinaryMathExpression extends BinaryExpression with CudfBinaryExpression with Serializable with ImplicitCastInputTypes
  21. abstract class CudfBinaryPredicateWithSideEffect extends CudfBinaryOperator with Predicate
  22. abstract class CudfUnaryMathExpression extends GpuUnaryMathExpression with CudfUnaryExpression
  23. class ExecutionPlanCaptureCallback extends QueryExecutionListener

    Used as a part of testing to capture the executed query plan.

  24. trait ExecutionPlanCaptureCallbackBase extends AnyRef
  25. class FromUTCTimestampExprMeta extends ConvertUTCTimestampExprMetaBase[FromUTCTimestamp]
  26. class FromUnixTimeMeta extends UnixTimeExprMeta[FromUnixTime]
  27. case class GpuAbs(child: Expression, failOnError: Boolean) extends GpuUnaryExpression with CudfUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  28. case class GpuAcos(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  29. case class GpuAcoshCompat(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  30. case class GpuAcoshImproved(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  31. case class GpuAdd(left: Expression, right: Expression, failOnError: Boolean) extends GpuAddBase with Product with Serializable
  32. abstract class GpuAddBase extends CudfBinaryArithmetic with Serializable
  33. case class GpuAnd(left: Expression, right: Expression) extends CudfBinaryPredicateWithSideEffect with Product with Serializable
  34. trait GpuArrayBinaryLike extends Expression with GpuComplexTypeMergingExpression with NullIntolerant
  35. case class GpuArrayContains(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with NullIntolerant with Product with Serializable

    Checks if the array (left) has the element (right)

  36. case class GpuArrayExcept(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  37. case class GpuArrayIntersect(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  38. case class GpuArrayJoin(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  39. abstract class GpuArrayMax extends GpuUnaryExpression with ImplicitCastInputTypes with Serializable
  40. abstract class GpuArrayMin extends GpuUnaryExpression with ImplicitCastInputTypes with Serializable
  41. case class GpuArrayRemove(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with Product with Serializable
  42. case class GpuArrayRepeat(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with Product with Serializable
  43. case class GpuArrayUnion(left: Expression, right: Expression) extends Expression with GpuArrayBinaryLike with ExpectsInputTypes with Product with Serializable
  44. case class GpuArraysOverlap(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  45. case class GpuArraysZip(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  46. case class GpuAsin(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  47. case class GpuAsinhCompat(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  48. case class GpuAsinhImproved(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  49. case class GpuAtan(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  50. case class GpuAtanh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  51. case class GpuAvroMultiFilePartitionReaderFactory(sqlConf: SQLConf, rapidsConf: RapidsConf, broadcastedConf: Broadcast[SerializableConfiguration], dataSchema: StructType, readDataSchema: StructType, partitionSchema: StructType, options: AvroOptions, metrics: Map[String, GpuMetric], filters: Array[Filter], queryUsesInputFile: Boolean) extends MultiFilePartitionReaderFactoryBase with Product with Serializable

    The multi-file partition reader factory for cloud or coalescing reading of avro file format.

  52. class GpuAvroPartitionReader extends FilePartitionReaderBase with GpuAvroReaderBase

    A PartitionReader that reads an AVRO file split on the GPU.

  53. case class GpuAvroPartitionReaderFactory(sqlConf: SQLConf, rapidsConf: RapidsConf, broadcastedConf: Broadcast[SerializableConfiguration], dataSchema: StructType, readDataSchema: StructType, partitionSchema: StructType, avroOptions: AvroOptions, metrics: Map[String, GpuMetric], params: Map[String, String]) extends ShimFilePartitionReaderFactory with Logging with Product with Serializable

    Avro partition reader factory to build columnar reader

  54. trait GpuAvroReaderBase extends Logging

    A trait collecting common methods across the 3 kinds of avro readers

  55. case class GpuAvroScan(sparkSession: SparkSession, fileIndex: PartitioningAwareFileIndex, dataSchema: StructType, readDataSchema: StructType, readPartitionSchema: StructType, options: CaseInsensitiveStringMap, pushedFilters: Array[Filter], rapidsConf: RapidsConf, partitionFilters: Seq[Expression] = Seq.empty, dataFilters: Seq[Expression] = Seq.empty, queryUsesInputFile: Boolean = false) extends FileScan with GpuScan with Product with Serializable
  56. case class GpuBRound(child: Expression, scale: Expression, outputType: DataType) extends GpuRoundBase with Product with Serializable
  57. case class GpuBasicArrayMax(child: Expression) extends GpuArrayMax with Product with Serializable

    ArrayMax without NaN handling

  58. case class GpuBasicArrayMin(child: Expression) extends GpuArrayMin with Product with Serializable

    ArrayMin without Nan handling

  59. case class GpuBitLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  60. case class GpuBitwiseAnd(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  61. case class GpuBitwiseNot(child: Expression) extends GpuUnaryExpression with CudfUnaryExpression with ExpectsInputTypes with Product with Serializable
  62. case class GpuBitwiseOr(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  63. case class GpuBitwiseXor(left: Expression, right: Expression) extends CudfBinaryArithmetic with Product with Serializable
  64. class GpuCartesianPartition extends Partition
  65. case class GpuCartesianProductExec(left: SparkPlan, right: SparkPlan, condition: Option[Expression], targetSizeBytes: Long) extends SparkPlan with ShimBinaryExecNode with GpuExec with Product with Serializable
  66. class GpuCartesianRDD extends RDD[ColumnarBatch] with Serializable
  67. case class GpuCbrt(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  68. case class GpuCeil(child: Expression, outputType: DataType) extends CudfUnaryMathExpression with Product with Serializable
  69. case class GpuConcat(children: Seq[Expression]) extends Expression with GpuComplexTypeMergingExpression with Product with Serializable
  70. case class GpuConcatWs(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ImplicitCastInputTypes with Product with Serializable
  71. case class GpuContains(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  72. case class GpuConv(num: Expression, fromBase: Expression, toBase: Expression) extends TernaryExpression with GpuTernaryExpression with Product with Serializable
  73. class GpuConvMeta extends TernaryExprMeta[Conv]
  74. case class GpuCos(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  75. case class GpuCosh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  76. case class GpuCot(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  77. case class GpuCreateArray(children: Seq[Expression], useStringTypeWhenEmpty: Boolean) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  78. case class GpuCreateMap(children: Seq[Expression], useStringTypeWhenEmpty: Boolean) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  79. case class GpuCreateNamedStruct(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with Product with Serializable
  80. case class GpuDataSource(sparkSession: SparkSession, className: String, paths: Seq[String] = Nil, userSpecifiedSchema: Option[StructType] = None, partitionColumns: Seq[String] = Seq.empty, bucketSpec: Option[BucketSpec] = None, options: Map[String, String] = Map.empty, catalogTable: Option[CatalogTable] = None, origProvider: Class[_], gpuFileFormat: ColumnarFileFormat) extends GpuDataSourceBase with Product with Serializable
  81. abstract class GpuDataSourceBase extends Logging

    A truncated version of Spark DataSource that converts to use the GPU version of InsertIntoHadoopFsRelationCommand for FileFormats we support.

    A truncated version of Spark DataSource that converts to use the GPU version of InsertIntoHadoopFsRelationCommand for FileFormats we support. This does not support DataSource V2 writing at this point because at the time of copying, it did not.

  82. trait GpuDataSourceScanExec extends SparkPlan with ShimLeafExecNode with GpuExec

    GPU implementation of Spark's DataSourceScanExec

  83. case class GpuDateAdd(startDate: Expression, days: Expression) extends BinaryExpression with GpuDateMathBase with Product with Serializable
  84. case class GpuDateAddInterval(start: Expression, interval: Expression, timeZoneId: Option[String] = None, ansiEnabled: Boolean = SQLConf.get.ansiEnabled) extends GpuTimeMath with Product with Serializable
  85. case class GpuDateDiff(endDate: Expression, startDate: Expression) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with Product with Serializable
  86. case class GpuDateFormatClass(timestamp: Expression, format: Expression, strfFormat: String, timeZoneId: Option[String] = None) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ImplicitCastInputTypes with Product with Serializable
  87. trait GpuDateMathBase extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes
  88. case class GpuDateSub(startDate: Expression, days: Expression) extends BinaryExpression with GpuDateMathBase with Product with Serializable
  89. trait GpuDateUnaryExpression extends GpuUnaryExpression with ImplicitCastInputTypes
  90. case class GpuDayOfMonth(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  91. case class GpuDayOfWeek(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  92. case class GpuDayOfYear(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  93. case class GpuDecimalDivide(left: Expression, right: Expression, dataType: DecimalType, failOnError: Boolean = SQLConf.get.ansiEnabled) extends Expression with ShimExpression with GpuDecimalDivideBase with Product with Serializable
  94. trait GpuDecimalDivideBase extends Expression with GpuExpression

    A version of Divide specifically for DecimalType that does not force the left and right to be the same type.

    A version of Divide specifically for DecimalType that does not force the left and right to be the same type. This lets us calculate the correct result on a wider range of values without the need for unbounded precision in the processing.

  95. case class GpuDecimalMultiply(left: Expression, right: Expression, dataType: DecimalType, useLongMultiply: Boolean = false, failOnError: Boolean = SQLConf.get.ansiEnabled) extends Expression with ShimExpression with GpuDecimalMultiplyBase with Product with Serializable
  96. trait GpuDecimalMultiplyBase extends Expression with GpuExpression
  97. trait GpuDivModLike extends CudfBinaryArithmetic
  98. case class GpuDivide(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends CudfBinaryArithmetic with GpuDivModLike with Product with Serializable
  99. class GpuDynamicPartitionDataConcurrentWriter extends GpuDynamicPartitionDataSingleWriter with Logging

    Dynamic partition writer with concurrent writers, meaning multiple concurrent writers are opened for writing.

    Dynamic partition writer with concurrent writers, meaning multiple concurrent writers are opened for writing.

    The process has the following steps:

    • Step 1: Maintain a map of output writers per each partition columns. Keep all writers opened; Cache the inputted batches by splitting them into sub-groups and each partition holds a list of spillable sub-groups; Find and write the max pending partition data if the total caches exceed the limitation.
    • Step 2: If number of concurrent writers exceeds limit, fall back to sort-based write (GpuDynamicPartitionDataSingleWriter), sort rest of batches on partition. Write batch by batch, and eagerly close the writer when finishing Caller is expected to call writeWithIterator() instead of write() to write records. Note: when fall back to GpuDynamicPartitionDataSingleWriter, the single writer should restore un-closed writers and should handle un-flushed spillable caches.
  100. class GpuDynamicPartitionDataSingleWriter extends GpuFileFormatDataWriter

    Dynamic partition writer with single writer, meaning only one writer is opened at any time for writing, meaning this single function can write to multiple directories (partitions) or files (bucketing).

    Dynamic partition writer with single writer, meaning only one writer is opened at any time for writing, meaning this single function can write to multiple directories (partitions) or files (bucketing). The data to be written are required to be sorted on partition and/or bucket column(s) before writing.

  101. case class GpuElementAt(left: Expression, right: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with Product with Serializable
  102. class GpuEmptyDirectoryDataWriter extends GpuFileFormatDataWriter

    GPU data writer for empty partitions

  103. case class GpuEndsWith(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  104. case class GpuEqualNullSafe(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable
  105. case class GpuEqualTo(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Equal-to.

    The table below shows how the result is calculated for Equal-to. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    Return (lhs.nan && rhs.nan) || result[i]

    +-------------+------------+------------------+---------------+----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | eq | +-------------+------------+------------------+---------------+----+ | t | f | f | r | f | | f | t | f | r | f | | t | t | f | t | t | | f | f | r | r | na | +-------------+------------+------------------+---------------+----+

  106. case class GpuEqualToNoNans(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    This implementation leverages the default implementation of equal-to on the GPU to perform the binary equals comparison.

    This implementation leverages the default implementation of equal-to on the GPU to perform the binary equals comparison. This is used for operations like PivotFirst, where NaN != NaN (unlike most other cases) when pivoting on a float or double column.

  107. case class GpuExp(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  108. case class GpuExpm1(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  109. abstract class GpuFileFormatDataWriter extends DataWriter[ColumnarBatch]

    Abstract class for writing out data in a single Spark task using the GPU.

    Abstract class for writing out data in a single Spark task using the GPU. This is the GPU version of org.apache.spark.sql.execution.datasources.FileFormatDataWriter.

  110. case class GpuFileSourceScanExec(relation: HadoopFsRelation, originalOutput: Seq[Attribute], requiredSchema: StructType, partitionFilters: Seq[Expression], optionalBucketSet: Option[BitSet], optionalNumCoalescedBuckets: Option[Int], dataFilters: Seq[Expression], tableIdentifier: Option[TableIdentifier], disableBucketedScan: Boolean = false, queryUsesInputFile: Boolean = false, alluxioPathsMap: Option[Map[String, String]], requiredPartitionSchema: Option[StructType] = None)(rapidsConf: RapidsConf) extends SparkPlan with GpuDataSourceScanExec with GpuExec with Product with Serializable

    GPU version of Spark's FileSourceScanExec

    GPU version of Spark's FileSourceScanExec

    relation

    The file-based relation to scan.

    originalOutput

    Output attributes of the scan, including data attributes and partition attributes.

    requiredSchema

    Required schema of the underlying relation, excluding partition columns.

    partitionFilters

    Predicates to use for partition pruning.

    optionalBucketSet

    Bucket ids for bucket pruning.

    optionalNumCoalescedBuckets

    Number of coalesced buckets.

    dataFilters

    Filters on non-partition columns.

    tableIdentifier

    identifier for the table in the metastore.

    disableBucketedScan

    Disable bucketed scan based on physical query plan.

    queryUsesInputFile

    This is a parameter to easily allow turning it off in GpuTransitionOverrides if InputFileName, InputFileBlockStart, or InputFileBlockLength are used

    alluxioPathsMap

    Map containing mapping of DFS scheme to Alluxio scheme

    rapidsConf

    Rapids conf

  111. case class GpuFlattenArray(child: Expression) extends GpuUnaryExpression with NullIntolerant with Product with Serializable
  112. case class GpuFloatArrayMax(child: Expression) extends GpuArrayMax with Product with Serializable

    ArrayMax for FloatType and DoubleType to handle Nans.

    ArrayMax for FloatType and DoubleType to handle Nans.

    In Spark, Nan is the max float value, however in cuDF, the calculation involving Nan is undefined. We design a workaround method here to match the Spark's behaviour. The high level idea is that, we firstly check if each list contains Nan. If it is, the max value is Nan, else we use the cuDF kernel to calculate the max value.

  113. case class GpuFloatArrayMin(child: Expression) extends GpuArrayMin with Product with Serializable

    ArrayMin for FloatType and DoubleType to handle Nans.

    ArrayMin for FloatType and DoubleType to handle Nans.

    In Spark, Nan is the max float value, however in cuDF, the calculation involving Nan is undefined. We design a workaround method here to match the Spark's behaviour. The high level idea is: if one list contains only Nans or nulls then if the list contains Nan then return Nan else return null else replace all Nans with nulls; use cuDF kernel to find the min value

  114. case class GpuFloor(child: Expression, outputType: DataType) extends CudfUnaryMathExpression with Product with Serializable
  115. case class GpuFormatNumber(x: Expression, d: Expression) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  116. case class GpuFromUTCTimestamp(timestamp: Expression, timezone: Expression, zoneId: ZoneId) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  117. case class GpuFromUnixTime(sec: Expression, format: Expression, strfFormat: String, colConverter: Option[(ColumnView) ⇒ ColumnVector], timeZoneId: Option[String]) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ImplicitCastInputTypes with Product with Serializable
  118. case class GpuGetArrayItem(child: Expression, ordinal: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ExpectsInputTypes with ShimGetArrayItem with Product with Serializable

    Returns the field at ordinal in the Array child.

    Returns the field at ordinal in the Array child.

    We need to do type checking here as ordinal expression maybe unresolved.

  119. case class GpuGetArrayStructFields(child: Expression, field: StructField, ordinal: Int, numFields: Int, containsNull: Boolean) extends GpuUnaryExpression with ShimGetArrayStructFields with NullIntolerant with Product with Serializable

    For a child whose data type is an array of structs, extracts the ordinal-th fields of all array elements, and returns them as a new array.

    For a child whose data type is an array of structs, extracts the ordinal-th fields of all array elements, and returns them as a new array.

    No need to do type checking since it is handled by 'ExtractValue'.

  120. class GpuGetArrayStructFieldsMeta extends UnaryExprMeta[GetArrayStructFields]
  121. case class GpuGetMapValue(child: Expression, key: Expression, failOnError: Boolean) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  122. case class GpuGetStructField(child: Expression, ordinal: Int, name: Option[String] = None) extends UnaryExpression with ShimUnaryExpression with GpuExpression with ShimGetStructField with NullIntolerant with Product with Serializable
  123. case class GpuGetTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  124. case class GpuGreaterThan(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for greater-than.

    The table below shows how the result is calculated for greater-than. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return (lhs.nan && !lhs.nan) || result[i]

    +-------------+------------+-----------------+---------------+----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | gt | +-------------+------------+-----------------+---------------+----+ | t | f | f | t | t | | f | t | f | r | f | | t | t | f | r | f | | f | f | r | r | na | +-------------+------------+-----------------+---------------+----+

  125. case class GpuGreaterThanOrEqual(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Greater-than-Eq.

    The table below shows how the result is calculated for Greater-than-Eq. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return lhs.isNan || result[i]

    +-------------+------------+-----------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | gte | +-------------+------------+-----------------+---------------+-----+ | t | f | f | t | t | | f | t | f | r | f | | t | t | f | t | t | | f | f | r | r | NA | +-------------+------------+-----------------+---------------+-----+

  126. case class GpuGreatest(children: Seq[Expression]) extends Expression with GpuGreatestLeastBase with Product with Serializable
  127. trait GpuGreatestLeastBase extends Expression with ComplexTypeMergingExpression with GpuExpression with ShimExpression
  128. abstract class GpuHashExpression extends Expression with GpuExpression with ShimExpression
  129. case class GpuHiveHash(children: Seq[Expression]) extends GpuHashExpression with Product with Serializable
  130. case class GpuHour(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  131. case class GpuHypot(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  132. case class GpuInMemoryTableScanExec(attributes: Seq[Attribute], predicates: Seq[Expression], relation: InMemoryRelation) extends SparkPlan with ShimLeafExecNode with GpuExec with Product with Serializable
  133. case class GpuInitCap(child: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  134. case class GpuInputFileBlockLength() extends GpuLeafExpression with Product with Serializable

    Returns the length of the block being read, or -1 if not available.

    Returns the length of the block being read, or -1 if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  135. case class GpuInputFileBlockStart() extends GpuLeafExpression with Product with Serializable

    Returns the start offset of the block being read, or -1 if not available.

    Returns the start offset of the block being read, or -1 if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  136. case class GpuInputFileName() extends GpuLeafExpression with Product with Serializable

    Returns the name of the file being read, or empty string if not available.

    Returns the name of the file being read, or empty string if not available. This is extra difficult because we cannot coalesce batches in between when this is used and the input file or else we could run into problems with returning the wrong thing.

  137. case class GpuInsertIntoHadoopFsRelationCommand(outputPath: Path, staticPartitions: TablePartitionSpec, ifPartitionNotExists: Boolean, partitionColumns: Seq[Attribute], bucketSpec: Option[BucketSpec], fileFormat: ColumnarFileFormat, options: Map[String, String], query: LogicalPlan, mode: SaveMode, catalogTable: Option[CatalogTable], fileIndex: Option[FileIndex], outputColumnNames: Seq[String], useStableSort: Boolean, concurrentWriterPartitionFlushSize: Long) extends LogicalPlan with GpuDataWritingCommand with Product with Serializable
  138. case class GpuIntegralDivide(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuIntegralDivideParent with Product with Serializable
  139. abstract class GpuIntegralDivideParent extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  140. case class GpuJsonToStructs(schema: DataType, options: Map[String, String], child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with TimeZoneAwareExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  141. case class GpuLastDay(startDate: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  142. case class GpuLeast(children: Seq[Expression]) extends Expression with GpuGreatestLeastBase with Product with Serializable
  143. case class GpuLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  144. case class GpuLessThan(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Less-than.

    The table below shows how the result is calculated for Less-than. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case return !lhs.nan && rhs.nan || result[i]

    +-------------+------------+-----------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | lt | +-------------+------------+-----------------+---------------+-----+ | t | f | f | r | f | | f | t | f | t | t | | t | t | f | r | f | | f | f | r | r | NA | +-------------+------------+-----------------+---------------+-----+

  145. case class GpuLessThanOrEqual(left: Expression, right: Expression) extends CudfBinaryComparison with NullIntolerant with Product with Serializable

    The table below shows how the result is calculated for Less-than-Eq.

    The table below shows how the result is calculated for Less-than-Eq. To make calculation easier we are leveraging the fact that the cudf-result(r) always returns false. So that result is used in place of false when needed.

    In this case, return rhs.nan || result[i]

    +-------------+------------+------------------+---------------+-----+ | lhs.isNan()| rhs.isNan | cudf-result(r) | final-result | lte | +-------------+------------+------------------+---------------+-----+ | t | f | f | r | f | | f | t | f | t | t | | t | t | f | t | t | | f | f | r | r | NA | +-------------+------------+------------------+---------------+-----+

  146. case class GpuLike(left: Expression, right: Expression, escapeChar: Char) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  147. case class GpuLiteralRangePattern(left: Expression, right: Expression, length: Int, start: Int, end: Int) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  148. case class GpuLog(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  149. case class GpuLogarithm(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  150. case class GpuLower(child: Expression) extends GpuUnaryString2StringExpression with Product with Serializable
  151. case class GpuMapConcat(children: Seq[Expression]) extends Expression with GpuComplexTypeMergingExpression with Product with Serializable
  152. case class GpuMapEntries(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  153. case class GpuMapFromArrays(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpression with Product with Serializable
  154. case class GpuMapKeys(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  155. case class GpuMapValues(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  156. case class GpuMd5(child: Expression) extends GpuUnaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  157. case class GpuMicrosToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  158. case class GpuMillisToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  159. case class GpuMinute(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  160. case class GpuMonth(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  161. class GpuMultiFileAvroPartitionReader extends MultiFileCoalescingPartitionReaderBase with GpuAvroReaderBase

    A PartitionReader that can read multiple AVRO files up to the certain size.

    A PartitionReader that can read multiple AVRO files up to the certain size. It will coalesce small files together and copy the block data in a separate thread pool to speed up processing the small files before sending down to the GPU.

  162. class GpuMultiFileCloudAvroPartitionReader extends MultiFileCloudPartitionReaderBase with MultiFileReaderFunctions with GpuAvroReaderBase

    A PartitionReader that can read multiple AVRO files in parallel.

    A PartitionReader that can read multiple AVRO files in parallel. This is most efficient running in a cloud environment where the I/O of reading is slow.

    When reading a file, it

    • seeks to the start position of the first block located in this partition.
    • next, parses the meta and sync, rewrites the meta and sync, and copies the data to a batch buffer per block, until reaching the last one of the current partition.
    • sends batches to GPU at last.
  163. case class GpuMultipleContains(input: Expression, searchList: Seq[String]) extends GpuUnaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  164. case class GpuMultiply(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends CudfBinaryArithmetic with Product with Serializable
  165. case class GpuMurmur3Hash(children: Seq[Expression], seed: Int) extends GpuHashExpression with Product with Serializable
  166. case class GpuNormalizeNaNAndZero(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  167. case class GpuNot(child: Expression) extends GpuUnaryExpression with CudfUnaryExpression with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  168. trait GpuNumberToTimestampUnaryExpression extends GpuUnaryExpression
  169. case class GpuOctetLength(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable
  170. case class GpuOr(left: Expression, right: Expression) extends CudfBinaryPredicateWithSideEffect with Product with Serializable
  171. class GpuOrcFileFormat extends ColumnarFileFormat with Logging
  172. class GpuOrcWriter extends ColumnarOutputWriter
  173. case class GpuParseUrl(children: Seq[Expression]) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  174. class GpuPartitionwiseSampledRDD extends PartitionwiseSampledRDD[ColumnarBatch, ColumnarBatch]
  175. case class GpuPmod(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuPmodBase with Product with Serializable
  176. abstract class GpuPmodBase extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  177. class GpuPoissonSampler extends PoissonSampler[ColumnarBatch]
  178. case class GpuPow(left: Expression, right: Expression) extends CudfBinaryMathExpression with Product with Serializable
  179. case class GpuPreciseTimestampConversion(child: Expression, fromType: DataType, toType: DataType) extends GpuUnaryExpression with ExpectsInputTypes with Product with Serializable

    Expression used internally to convert the TimestampType to Long and back without losing precision, i.e.

    Expression used internally to convert the TimestampType to Long and back without losing precision, i.e. in microseconds. Used in time windowing.

  180. case class GpuQuarter(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  181. case class GpuRLike(left: Expression, right: Expression, pattern: String) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  182. class GpuRLikeMeta extends BinaryExprMeta[RLike]
  183. class GpuReadAvroFileFormat extends AvroFileFormat with GpuReadFileFormatWithMetrics

    A FileFormat that allows reading Avro files with the GPU.

  184. case class GpuRegExpExtract(subject: Expression, regexp: Expression, idx: Expression)(cudfRegexPattern: String) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  185. case class GpuRegExpExtractAll(str: Expression, regexp: Expression, idx: Expression)(cudfRegexPattern: String) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  186. class GpuRegExpExtractAllMeta extends TernaryExprMeta[RegExpExtractAll]
  187. class GpuRegExpExtractMeta extends TernaryExprMeta[RegExpExtract]
  188. case class GpuRegExpReplace(srcExpr: Expression, searchExpr: Expression, replaceExpr: Expression)(javaRegexpPattern: String, cudfRegexPattern: String, cudfReplacementString: String, searchList: Option[Seq[String]], replaceOpt: Option[GpuRegExpReplaceOpt]) extends GpuRegExpTernaryBase with ImplicitCastInputTypes with HasGpuStringReplace with Product with Serializable
  189. case class GpuRegExpReplaceWithBackref(child: Expression, searchExpr: Expression, replaceExpr: Expression)(javaRegexpPattern: String, cudfRegexPattern: String, cudfReplacementString: String) extends GpuUnaryExpression with ImplicitCastInputTypes with Product with Serializable
  190. abstract class GpuRegExpTernaryBase extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar
  191. case class GpuRemainder(left: Expression, right: Expression, failOnError: Boolean = SQLConf.get.ansiEnabled) extends GpuRemainderBase with Product with Serializable
  192. abstract class GpuRemainderBase extends CudfBinaryArithmetic with GpuDivModLike with Serializable
  193. case class GpuReverse(child: Expression) extends GpuUnaryExpression with Product with Serializable
  194. case class GpuRint(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  195. case class GpuRound(child: Expression, scale: Expression, outputType: DataType) extends GpuRoundBase with Product with Serializable
  196. abstract class GpuRoundBase extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Serializable with ImplicitCastInputTypes
  197. case class GpuRowBasedScalaUDF(sparkFunc: AnyRef, dataType: DataType, children: Seq[Expression], inputEncoders: Seq[Option[ExpressionEncoder[_]]], outputEncoder: Option[ExpressionEncoder[_]], udfName: Option[String], nullable: Boolean, udfDeterministic: Boolean) extends Expression with GpuRowBasedUserDefinedFunction with Product with Serializable
  198. case class GpuScalaUDF(function: RapidsUDF, dataType: DataType, children: Seq[Expression], udfName: Option[String], nullable: Boolean, udfDeterministic: Boolean) extends Expression with GpuUserDefinedFunction with Product with Serializable
  199. case class GpuScalarSubquery(plan: BaseSubqueryExec, exprId: ExprId) extends ExecSubqueryExpression with GpuExpression with ShimExpression with Product with Serializable

    GPU placeholder of ScalarSubquery, which returns the scalar result with columnarEval method.

    GPU placeholder of ScalarSubquery, which returns the scalar result with columnarEval method. This placeholder is to make ScalarSubquery working as a GPUExpression to cooperate other GPU overrides.

  200. case class GpuSecond(child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with GpuTimeUnaryExpression with Product with Serializable
  201. case class GpuSecondsToTimestamp(child: Expression) extends GpuUnaryExpression with GpuNumberToTimestampUnaryExpression with Product with Serializable
  202. case class GpuSequence(start: Expression, stop: Expression, stepOpt: Option[Expression], timeZoneId: Option[String] = None) extends Expression with TimeZoneAwareExpression with GpuExpression with ShimExpression with Product with Serializable
  203. class GpuSequenceMeta extends ExprMeta[Sequence]
  204. class GpuSerializableBatch extends Serializable with AutoCloseable
    Annotations
    @SerialVersionUID()
  205. trait GpuShiftBase extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes
  206. case class GpuShiftLeft(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  207. case class GpuShiftRight(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  208. case class GpuShiftRightUnsigned(left: Expression, right: Expression) extends BinaryExpression with GpuShiftBase with Product with Serializable
  209. abstract class GpuShuffleBlockResolverBase extends ShuffleBlockResolver with Logging
  210. class GpuShuffleDependency[K, V, C] extends ShuffleDependency[K, V, C]
  211. class GpuShuffleEnv extends Logging
  212. class GpuShuffleHandle[K, V] extends BaseShuffleHandle[K, V, V]
  213. case class GpuSignum(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  214. case class GpuSin(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  215. class GpuSingleDirectoryDataWriter extends GpuFileFormatDataWriter

    Writes data to a single directory (used for non-dynamic-partition writes).

  216. case class GpuSinh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  217. case class GpuSize(child: Expression, legacySizeOfNull: Boolean) extends GpuUnaryExpression with Product with Serializable
  218. case class GpuSortArray(base: Expression, ascendingOrder: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ExpectsInputTypes with Product with Serializable
  219. case class GpuSqrt(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  220. case class GpuStartsWith(left: Expression, right: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with Predicate with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  221. case class GpuStringInstr(str: Expression, substr: Expression) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  222. case class GpuStringLPad(str: Expression, len: Expression, pad: Expression) extends TernaryExpression with BasePad with Product with Serializable
  223. case class GpuStringLocate(substr: Expression, col: Expression, start: Expression) extends TernaryExpression with GpuTernaryExpressionArgsScalarAnyScalar with ImplicitCastInputTypes with Product with Serializable
  224. case class GpuStringRPad(str: Expression, len: Expression, pad: Expression) extends TernaryExpression with BasePad with Product with Serializable
  225. case class GpuStringRepeat(input: Expression, repeatTimes: Expression) extends BinaryExpression with GpuBinaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  226. case class GpuStringReplace(srcExpr: Expression, searchExpr: Expression, replaceExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with HasGpuStringReplace with Product with Serializable
  227. case class GpuStringSplit(str: Expression, regex: Expression, limit: Expression, pattern: String, isRegExp: Boolean) extends TernaryExpression with GpuTernaryExpression with ImplicitCastInputTypes with Product with Serializable
  228. class GpuStringSplitMeta extends StringSplitRegExpMeta[StringSplit]
  229. case class GpuStringToMap(strExpr: Expression, pairDelimExpr: Expression, keyValueDelimExpr: Expression, pairDelim: String, isPairDelimRegExp: Boolean, keyValueDelim: String, isKeyValueDelimRegExp: Boolean) extends Expression with GpuExpression with ShimExpression with ExpectsInputTypes with Product with Serializable
  230. class GpuStringToMapMeta extends StringSplitRegExpMeta[StringToMap]
  231. case class GpuStringTranslate(srcExpr: Expression, fromExpr: Expression, toExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with Product with Serializable
  232. case class GpuStringTrim(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  233. case class GpuStringTrimLeft(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  234. case class GpuStringTrimRight(column: Expression, trimParameters: Option[Expression] = None) extends Expression with GpuString2TrimExpression with ImplicitCastInputTypes with Product with Serializable
  235. case class GpuStructsToJson(options: Map[String, String], child: Expression, timeZoneId: Option[String] = None) extends GpuUnaryExpression with Product with Serializable
  236. class GpuStructsToJsonMeta extends UnaryExprMeta[StructsToJson]
  237. case class GpuSubstring(str: Expression, pos: Expression, len: Expression) extends TernaryExpression with GpuTernaryExpression with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  238. case class GpuSubstringIndex(strExpr: Expression, ignoredDelimExpr: Expression, ignoredCountExpr: Expression) extends TernaryExpression with GpuTernaryExpressionArgsAnyScalarScalar with ImplicitCastInputTypes with Product with Serializable
  239. case class GpuSubtract(left: Expression, right: Expression, failOnError: Boolean) extends GpuSubtractBase with Product with Serializable
  240. abstract class GpuSubtractBase extends CudfBinaryArithmetic with Serializable
  241. case class GpuTan(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  242. case class GpuTanh(child: Expression) extends CudfUnaryMathExpression with Product with Serializable
  243. class GpuTaskMetrics extends Serializable
  244. abstract class GpuTimeMath extends BinaryExpression with ShimBinaryExpression with GpuExpression with TimeZoneAwareExpression with ExpectsInputTypes with Serializable
  245. trait GpuTimeUnaryExpression extends GpuUnaryExpression with TimeZoneAwareExpression with ImplicitCastInputTypes with NullIntolerant
  246. case class GpuToDegrees(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  247. case class GpuToRadians(child: Expression) extends GpuUnaryMathExpression with Product with Serializable
  248. abstract class GpuToTimestamp extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with TimeZoneAwareExpression with ExpectsInputTypes

    A direct conversion of Spark's ToTimestamp class which converts time to UNIX timestamp by first converting to microseconds and then dividing by the downScaleFactor

  249. case class GpuToUTCTimestamp(timestamp: Expression, timezone: Expression, zoneId: ZoneId) extends BinaryExpression with GpuBinaryExpressionArgsAnyScalar with ImplicitCastInputTypes with NullIntolerant with Product with Serializable
  250. case class GpuToUnixTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  251. abstract class GpuUnaryMathExpression extends GpuUnaryExpression with Serializable with ImplicitCastInputTypes
  252. case class GpuUnaryMinus(child: Expression, failOnError: Boolean) extends GpuUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  253. case class GpuUnaryPositive(child: Expression) extends GpuUnaryExpression with ExpectsInputTypes with NullIntolerant with Product with Serializable
  254. abstract class GpuUnaryString2StringExpression extends GpuUnaryExpression with ExpectsInputTypes
  255. case class GpuUnixTimestamp(strTs: Expression, format: Expression, sparkFormat: String, strf: String, timeZoneId: Option[String] = None) extends GpuToTimestamp with Product with Serializable
  256. case class GpuUpper(child: Expression) extends GpuUnaryString2StringExpression with Product with Serializable
  257. case class GpuWeekDay(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  258. class GpuWriteJobDescription extends Serializable

    A shared job description for all the GPU write tasks.

    A shared job description for all the GPU write tasks. This is the GPU version of org.apache.spark.sql.execution.datasources.WriteJobDescription.

  259. class GpuWriteJobStatsTracker extends BasicColumnarWriteJobStatsTracker

    Simple ColumnarWriteJobStatsTracker implementation that's serializable, capable of instantiating GpuWriteTaskStatsTracker on executors and processing the WriteTaskStats they produce by aggregating the metrics and posting them as DriverMetricUpdates.

  260. class GpuWriteTaskStatsTracker extends BasicColumnarWriteTaskStatsTracker

    ColumnarWriteTaskStatsTracker implementation that produces WriteTaskStats and tracks writing times per task.

  261. case class GpuWriterBucketSpec(bucketIdExpression: GpuExpression, bucketFileNamePrefix: (Int) ⇒ String) extends Product with Serializable

    Bucketing specification for all the write tasks.

    Bucketing specification for all the write tasks. This is the GPU version of org.apache.spark.sql.execution.datasources.WriterBucketSpec

    bucketIdExpression

    Expression to calculate bucket id based on bucket column(s).

    bucketFileNamePrefix

    Prefix of output file name based on bucket id.

  262. case class GpuXxHash64(children: Seq[Expression], seed: Long) extends GpuHashExpression with Product with Serializable
  263. case class GpuYear(child: Expression) extends GpuUnaryExpression with GpuDateUnaryExpression with Product with Serializable
  264. trait HasGpuStringReplace extends AnyRef
  265. class HighWatermarkAccumulator extends AccumulatorV2[Long, Long]
  266. class InMemoryTableScanMeta extends SparkPlanMeta[InMemoryTableScanExec]
  267. class JsonDeviceDataSource extends DataSource
  268. class JsonParsingException extends RuntimeException

    Exception thrown when cudf cannot parse the JSON data because some Json to Struct cases are not currently supported.

  269. class NanoSecondAccumulator extends AccumulatorV2[Long, NanoTime]
  270. case class NanoTime(value: Long) extends Product with Serializable
  271. case class ParseFormatMeta(separator: Option[Char], isTimestamp: Boolean, validRegex: String) extends Product with Serializable
  272. class RapidsCachingReader[K, C] extends ShuffleReader[K, C] with Logging
  273. class RapidsCachingWriter[K, V] extends ShuffleWriter[K, V] with Logging
  274. class RapidsDiskBlockManager extends AnyRef

    Maps logical blocks to local disk locations.

  275. class RapidsShuffleInternalManagerBase extends ShuffleManager with RapidsShuffleHeartbeatHandler with Logging

    A shuffle manager optimized for the RAPIDS Plugin For Apache Spark.

    A shuffle manager optimized for the RAPIDS Plugin For Apache Spark.

    Note

    This is an internal class to obtain access to the private ShuffleManager and SortShuffleManager classes. When configuring Apache Spark to use the RAPIDS shuffle manager,

  276. abstract class RapidsShuffleThreadedReaderBase[K, C] extends ShuffleReader[K, C] with Logging
  277. abstract class RapidsShuffleThreadedWriterBase[K, V] extends ShuffleWriter[K, V] with RapidsShuffleWriterShimHelper with Logging
  278. trait RapidsShuffleWriterShimHelper extends AnyRef
  279. case class RegexReplace(search: String, replace: String) extends Product with Serializable
  280. class ShimmedExecutionPlanCaptureCallbackImpl extends ExecutionPlanCaptureCallbackBase

    Note that the name is prefixed with "Shimmed" such that wildcard rules under unshimmed-common-from-spark320.txt don't get confused and pick this class to be un-shimmed.

  281. class ShuffleHandleWithMetrics[K, V, C] extends BaseShuffleHandle[K, V, C]
  282. trait ShuffleMetricsUpdater extends AnyRef
  283. abstract class StringSplitRegExpMeta[INPUT <: TernaryExpression] extends TernaryExprMeta[INPUT]
  284. class SubstringIndexMeta extends TernaryExprMeta[SubstringIndex]
  285. case class TempSpillBufferId extends RapidsBufferId with Product with Serializable
  286. class ThreadSafeShuffleWriteMetricsReporter extends ShuffleWriteMetrics

    The ShuffleWriteMetricsReporter is based on accumulators, which are not thread safe.

    The ShuffleWriteMetricsReporter is based on accumulators, which are not thread safe. This class is a thin wrapper that adds synchronization, since these metrics will be written by multiple threads.

  287. sealed trait TimeParserPolicy extends Serializable
  288. class ToUTCTimestampExprMeta extends ConvertUTCTimestampExprMetaBase[ToUTCTimestamp]
  289. abstract class UnixTimeExprMeta[A <: BinaryExpression with TimeZoneAwareExpression] extends BinaryExprMeta[A]

Value Members

  1. object AddOverflowChecks
  2. object BasicColumnarWriteJobStatsTracker extends Serializable
  3. object BucketIdMetaUtils
  4. object CorrectedTimeParserPolicy extends TimeParserPolicy
  5. object CudfRegexp
  6. object DecimalDivideChecks
  7. object DecimalMultiplyChecks
  8. object ExceptionTimeParserPolicy extends TimeParserPolicy
  9. object ExecutionPlanCaptureCallback extends ExecutionPlanCaptureCallbackBase
  10. object ExternalSource extends Logging

    The subclass of AvroProvider imports spark-avro classes.

    The subclass of AvroProvider imports spark-avro classes. This file should not imports spark-avro classes because class not found exception may throw if spark-avro does not exist at runtime. Details see: https://github.com/NVIDIA/spark-rapids/issues/5648

  11. object GpuAnsi
  12. object GpuArrayMax extends Serializable
  13. object GpuArrayMin extends Serializable
  14. object GpuAvroScan extends Serializable
  15. object GpuCreateMap extends Serializable
  16. object GpuDataSourceBase extends Logging
  17. object GpuDataSourceScanExec extends Serializable
  18. object GpuDivModLike
  19. object GpuElementAtMeta
  20. object GpuFileFormatDataWriter
  21. object GpuFileFormatWriter extends Logging

    A helper object for writing columnar data out to a location.

  22. object GpuFileSourceScanExec extends Serializable
  23. object GpuFloorCeil
  24. object GpuHypot extends Serializable
  25. object GpuJsonReadCommon

    This is a utility method intended to provide common functionality between JsonToStructs and ScanJson

  26. object GpuLogarithm extends Serializable
  27. object GpuMurmur3Hash extends Serializable
  28. object GpuOrcFileFormat extends Logging
  29. object GpuParseUrl extends Serializable
  30. object GpuReadAvroFileFormat extends Serializable
  31. object GpuRegExpUtils
  32. object GpuScalaUDF extends Serializable
  33. object GpuScalaUDFMeta
  34. object GpuSequenceUtil
  35. object GpuShuffleEnv extends Logging
  36. object GpuStringInstr extends Serializable
  37. object GpuTaskMetrics extends Logging with Serializable

    Provides task level metrics

  38. object GpuToTimestamp
  39. object GpuV1WriteUtils
  40. object GpuWriteJobStatsTracker extends Serializable
  41. object InputFileUtils
  42. object LegacyTimeParserPolicy extends TimeParserPolicy
  43. object PCBSSchemaHelper
  44. object RapidsPrivateUtil
  45. object RapidsShuffleInternalManagerBase extends Logging
  46. object ShiftHelper
  47. object SubtractOverflowChecks
  48. object TempSpillBufferId extends Serializable
  49. object TimeZoneDB

Ungrouped