package rapids
- Alphabetic
- Public
- All
Type Members
-
class
AlphabeticallyReorderingColumnPartitionReader extends ColumnarPartitionReaderWithPartitionValues
Partition-reader styled similarly to
ColumnarPartitionReaderWithPartitionValues, but orders the output columns alphabetically.Partition-reader styled similarly to
ColumnarPartitionReaderWithPartitionValues, but orders the output columns alphabetically. This is required since the GpuHiveTableScanExec.requestedAttributes have the columns ordered alphabetically by name, even though the table schema (and hence, the file-schema) need not. - class GpuHiveDelimitedTextPartitionReader extends CSVPartitionReaderBase[HostStringColBufferer, HostStringColBuffererFactory.type]
-
case class
GpuHiveGenericUDF(name: String, funcWrapper: HiveFunctionWrapper, children: Seq[Expression], dataType: DataType, udfDeterministic: Boolean, foldable: Boolean) extends Expression with GpuHiveUDFBase with Product with Serializable
GPU-accelerated version of Spark's
HiveGenericUDF - class GpuHiveParquetFileFormat extends ColumnarFileFormat
- class GpuHiveParquetWriter extends ColumnarOutputWriter
-
case class
GpuHiveSimpleUDF(name: String, funcWrapper: HiveFunctionWrapper, children: Seq[Expression], dataType: DataType, udfDeterministic: Boolean) extends Expression with GpuHiveUDFBase with Product with Serializable
GPU-accelerated version of Spark's
HiveSimpleUDF -
case class
GpuHiveTableScanExec(requestedAttributes: Seq[Attribute], hiveTableRelation: HiveTableRelation, partitionPruningPredicate: Seq[Expression]) extends SparkPlan with GpuExec with ShimSparkPlan with LeafExecNode with CastSupport with Product with Serializable
RAPIDS replacement for the org.apache.spark.sql.hive.execution.HiveTableScanExec, for supporting reading Hive delimited text format.
RAPIDS replacement for the org.apache.spark.sql.hive.execution.HiveTableScanExec, for supporting reading Hive delimited text format.
While the HiveTableScanExec supports all the data formats that Hive does, the GpuHiveTableScanExec currently supports only text tables.
This GpuExec supports reading from Hive tables under the following conditions:
- The table is stored as TEXTFILE (i.e. input-format == TextInputFormat, serde == LazySimpleSerDe). 2. The table contains only columns of primitive types. Specifically, STRUCT, ARRAY, MAP, and BINARY are not supported. 3. The table uses Hive's default record delimiters ('Ctrl-A'), and line delimiters ('\n').
- requestedAttributes
Columns to be read from the table
- hiveTableRelation
The Hive table to be scanned
- partitionPruningPredicate
Partition-pruning predicate for Hive partitioned tables
- class GpuHiveTextFileFormat extends ColumnarFileFormat with Logging
- case class GpuHiveTextPartitionReaderFactory(sqlConf: SQLConf, broadcastConf: Broadcast[SerializableConfiguration], inputFileSchema: StructType, partitionSchema: StructType, requestedOutputDataSchema: StructType, requestedAttributes: Seq[Attribute], maxReaderBatchSizeRows: Integer, maxReaderBatchSizeBytes: Long, maxGpuColumnSizeBytes: Long, metrics: Map[String, GpuMetric], params: Map[String, String]) extends ShimFilePartitionReaderFactory with Product with Serializable
- class GpuHiveTextWriter extends ColumnarOutputWriter
-
trait
GpuHiveUDFBase extends Expression with GpuUserDefinedFunction
Common implementation across Hive UDFs
-
case class
GpuRowBasedHiveGenericUDF(name: String, funcWrapper: HiveFunctionWrapper, children: Seq[Expression]) extends Expression with GpuRowBasedHiveUDFBase with Product with Serializable
Row-based version of Spark's
HiveGenericUDFrunning in a GPU operation -
case class
GpuRowBasedHiveSimpleUDF(name: String, funcWrapper: HiveFunctionWrapper, children: Seq[Expression]) extends Expression with GpuRowBasedHiveUDFBase with Product with Serializable
Row-based version of Spark's
HiveSimpleUDFrunning in a GPU operation -
trait
GpuRowBasedHiveUDFBase extends Expression with GpuRowBasedUserDefinedFunction with HiveInspectorsShim
Common implementation across row-based Hive UDFs
- class HiveProviderImpl extends HiveProviderCmdShims
Value Members
- object GpuHiveFileFormat extends Logging
- object GpuHiveOverrides
- object GpuHiveTextFileUtils
- object RapidsHiveErrors