package shims
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
-
class
GpuArrowPythonRunner extends GpuArrowPythonRunnerBase
Similar to
PythonUDFRunner, but exchange data with Python worker via Arrow stream. - case class GpuArrowPythonRunnerShims(conf: SQLConf, chainedFunc: Seq[ChainedPythonFunctions], argOffsets: Array[Array[Int]], dedupAttrs: StructType, pythonOutputSchema: StructType) extends Product with Serializable
-
class
GpuCoGroupedArrowPythonRunner extends GpuPythonRunnerBase[(ColumnarBatch, ColumnarBatch)] with GpuPythonArrowOutput
Python UDF Runner for cogrouped UDFs, designed for
GpuFlatMapCoGroupsInPandasExeconly.Python UDF Runner for cogrouped UDFs, designed for
GpuFlatMapCoGroupsInPandasExeconly.It sends Arrow batches from two different DataFrames, groups them in Python, and receive it back in JVM as batches of single DataFrame.
-
trait
GpuPythonArrowOutput extends AnyRef
A trait that can be mixed-in with
GpuPythonRunnerBase.A trait that can be mixed-in with
GpuPythonRunnerBase. It implements the logic from Python (Arrow) to GPU/JVM (ColumnarBatch).
Value Members
- object GpuArrowPythonRunner