Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def castStringToBool(input: ColumnVector): ColumnVector

   CSV supports "true" and "false" (case-insensitive) as valid boolean values.

   CSV supports "true" and "false" (case-insensitive) as valid boolean values.

   Definition Classes

   GpuHiveDelimitedTextPartitionReader → CSVPartitionReaderBase → GpuTextBasedPartitionReader

6.  def castStringToDate(input: ColumnVector, dt: DType): ColumnVector

   Override of com.nvidia.spark.rapids.GpuTextBasedPartitionReader.castStringToDate(), to convert parsed string columns to Dates.

   Override of com.nvidia.spark.rapids.GpuTextBasedPartitionReader.castStringToDate(), to convert parsed string columns to Dates. Two key differences from the base implementation, to comply with Hive LazySimpleSerDe semantics:

   1. The input strings are not trimmed of whitespace. 2. Invalid date strings do not cause exceptions.

   Definition Classes

   GpuHiveDelimitedTextPartitionReader → GpuTextBasedPartitionReader

7.  def castStringToDecimal(input: ColumnVector, dt: DecimalType): ColumnVector

   Definition Classes

   GpuHiveDelimitedTextPartitionReader → GpuTextBasedPartitionReader

8.  def castStringToFloat(input: ColumnVector, dt: DType): ColumnVector

   Definition Classes

   GpuTextBasedPartitionReader

9.  def castStringToInt(input: ColumnVector, intType: DType): ColumnVector

   Definition Classes

   GpuHiveDelimitedTextPartitionReader → GpuTextBasedPartitionReader

10.  def castStringToTimestamp(lhs: ColumnVector, sparkFormat: String, dType: DType): ColumnVector

    Definition Classes

    GpuHiveDelimitedTextPartitionReader → GpuTextBasedPartitionReader

11.  def castTableToDesiredTypes(table: Table, readSchema: StructType): Table

    Definition Classes

    GpuTextBasedPartitionReader

12.  def clone(): AnyRef

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()

13.  def close(): Unit

    Definition Classes

    GpuTextBasedPartitionReader → Closeable → AutoCloseable

14.  def currentMetricsValues(): Array[CustomTaskMetric]

    Definition Classes

    PartitionReader

15.  def dateFormat: Option[String]

    Definition Classes

    CSVPartitionReaderBase → GpuTextBasedPartitionReader

16.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

17.  def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

18.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

19.  def get(): ColumnarBatch

    Definition Classes

    GpuTextBasedPartitionReader → PartitionReader

20.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

21.  def getCudfSchema(dataSchema: StructType): Schema

    Definition Classes

    GpuTextBasedPartitionReader

22.  def getFileFormatShortName: String

    File format short name used for logging and other things to uniquely identity which file format is being used.

    File format short name used for logging and other things to uniquely identity which file format is being used.

    returns

    the file format short name

    Definition Classes

    CSVPartitionReaderBase → GpuTextBasedPartitionReader

23.  def handleResult(readDataSchema: StructType, table: Table): Option[Table]

    Handle the table decoded by GPU

    Handle the table decoded by GPU

    Please note that, this function owns table which is supposed to be closed in this function But for the optimization, we just return the original table.

    readDataSchema

    the Spark schema describing what will be read

    table

    the table decoded by GPU

    returns

    the new optional Table

    Definition Classes

    GpuTextBasedPartitionReader

24.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

25.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

26.  val metrics: Map[String, GpuMetric]

    Definition Classes

    ScanWithMetrics

27.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

28.  def next(): Boolean

    Definition Classes

    GpuTextBasedPartitionReader → PartitionReader

29.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

30.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

31.  def readToTable(dataBufferer: HostStringColBufferer, cudfDataSchema: Schema, requestedOutputDataSchema: StructType, cudfReadDataSchema: Schema, isFirstChunk: Boolean, decodeTime: GpuMetric): Table

    Read the host buffer to GPU table

    Read the host buffer to GPU table

    cudfDataSchema

    the cudf schema of the data

    cudfReadDataSchema

    the cudf schema of just the data we want to read.

    isFirstChunk

    if it is the first chunk

    returns

    table

    Definition Classes

    GpuHiveDelimitedTextPartitionReader → GpuTextBasedPartitionReader

32.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

33.  def timestampFormat: String

    Definition Classes

    CSVPartitionReaderBase → GpuTextBasedPartitionReader

34.  def toString(): String

    Definition Classes

    AnyRef → Any

35.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

36.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

37.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()