package shims
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
-
trait
GpuArrowPythonOutput extends GpuArrowOutput
A trait that can be mixed-in with
GpuBasePythonRunner.A trait that can be mixed-in with
GpuBasePythonRunner. It implements the logic from Python (Arrow) to GPU/JVM (ColumnarBatch). -
class
GpuArrowPythonRunner extends GpuBasePythonRunner[ColumnarBatch] with GpuArrowPythonOutput with GpuPythonRunnerCommon
Similar to
PythonUDFRunner, but exchange data with Python worker via Arrow stream. - abstract class GpuBasePythonRunner[IN] extends BasePythonRunner[IN, ColumnarBatch]
-
class
GpuCoGroupedArrowPythonRunner extends GpuBasePythonRunner[(ColumnarBatch, ColumnarBatch)] with GpuArrowPythonOutput with GpuPythonRunnerCommon
Python UDF Runner for cogrouped UDFs, designed for
GpuFlatMapCoGroupsInPandasExeconly.Python UDF Runner for cogrouped UDFs, designed for
GpuFlatMapCoGroupsInPandasExeconly.It sends Arrow batches from two different DataFrames, groups them in Python, and receive it back in JVM as batches of single DataFrame.
- case class GpuGroupedPythonRunnerFactory(conf: SQLConf, chainedFunc: Seq[(ChainedPythonFunctions, Long)], argOffsets: Array[Array[Int]], dedupAttrs: StructType, pythonOutputSchema: StructType, evalType: Int) extends Product with Serializable
Value Members
- object WritePythonUDFUtils