Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

6.  def createBroadcastRelation(mode: BroadcastMode, child: SparkPlan, numOutputRows: SQLMetric, dataSize: SQLMetric): BuildSideRelation

   Create broadcast relation for BroadcastExchangeExec

   Create broadcast relation for BroadcastExchangeExec

   Definition Classes

   SparkPlanExecApiImpl → SparkPlanExecApi

7.  def createColumnarBatchSerializer(schema: StructType, metrics: Map[String, SQLMetric]): Serializer

   Generate ColumnarBatchSerializer for ColumnarShuffleExchangeExec.

   Generate ColumnarBatchSerializer for ColumnarShuffleExchangeExec.

   Definition Classes

   SparkPlanExecApiImpl → SparkPlanExecApi

8.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

9.  def equals(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

10.  def extraExpressionMappings: Seq[Sig]

    Define backend specfic expression mappings.

    Define backend specfic expression mappings.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

11.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

12.  def genAliasTransformer(substraitExprName: String, child: ExpressionTransformer, original: Expression): ExpressionTransformer

    Generate Alias transformer.

    Generate Alias transformer.

    returns

    a transformer for alias

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

13.  def genBroadcastHashJoinExecTransformer(leftKeys: Seq[Expression], rightKeys: Seq[Expression], joinType: JoinType, buildSide: BuildSide, condition: Option[Expression], left: SparkPlan, right: SparkPlan, isNullAwareAntiJoin: Boolean = false): BroadcastHashJoinExecTransformer

    Generate BroadcastHashJoinExecTransformer.

    Generate BroadcastHashJoinExecTransformer.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

14.  def genCastWithNewChild(c: Cast): Cast

    To align with spark in casting string type input to other types, add trim node for trimming space or whitespace.

    To align with spark in casting string type input to other types, add trim node for trimming space or whitespace. See spark's Cast.scala.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

15.  def genColumnarShuffleWriter[K, V](parameters: GenShuffleWriterParameters[K, V]): GlutenShuffleWriterWrapper[K, V]

    Generate ColumnarShuffleWriter for ColumnarShuffleManager.

    Generate ColumnarShuffleWriter for ColumnarShuffleManager.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

16.  def genColumnarToRowExec(child: SparkPlan): ColumnarToRowExecBase

    Generate ColumnarToRowExecBase.

    Generate ColumnarToRowExecBase.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

17.  def genEqualNullSafeTransformer(substraitExprName: String, left: ExpressionTransformer, right: ExpressionTransformer, original: EqualNullSafe): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

18.  def genExtendedAnalyzers(): List[(SparkSession) ⇒ Rule[LogicalPlan]]

    Generate extended Analyzer.

    Generate extended Analyzer.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

19.  def genExtendedColumnarPostRules(): List[(SparkSession) ⇒ Rule[SparkPlan]]

    Generate extended columnar post-rules.

    Generate extended columnar post-rules.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

20.  def genExtendedColumnarPreRules(): List[(SparkSession) ⇒ Rule[SparkPlan]]

    Generate extended columnar pre-rules.

    Generate extended columnar pre-rules.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

21.  def genExtendedDataSourceV2Strategies(): List[(SparkSession) ⇒ Strategy]

    Generate extended DataSourceV2 Strategy.

    Generate extended DataSourceV2 Strategy.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

22.  def genExtendedOptimizers(): List[(SparkSession) ⇒ Rule[LogicalPlan]]

    Generate extended Optimizer.

    Generate extended Optimizer. Currently only for Velox backend.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

23.  def genExtendedStrategies(): List[(SparkSession) ⇒ Strategy]

    Generate extended Strategy.

    Generate extended Strategy.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

24.  def genFilterExecTransformer(condition: Expression, child: SparkPlan): FilterExecTransformerBase

    Generate FilterExecTransformer.

    Generate FilterExecTransformer.

    condition

    : the filter condition

    child

    : the child of FilterExec

    returns

    the transformer of FilterExec

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

25.  def genGetArrayItemExpressionNode(substraitExprName: String, functionMap: Map[String, Long], leftNode: ExpressionNode, rightNode: ExpressionNode, original: GetArrayItem): ExpressionNode

    Transform GetArrayItem to Substrait.

    Transform GetArrayItem to Substrait.

    arrCol[index] => IF(index < 0, null, ElementAt(arrCol, index + 1))

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

26.  def genGetMapValueTransformer(substraitExprName: String, left: ExpressionTransformer, right: ExpressionTransformer, original: GetMapValue): ExpressionTransformer

    Generate an expression transformer to transform GetMapValue to Substrait.

    Generate an expression transformer to transform GetMapValue to Substrait.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

27.  def genGetStructFieldTransformer(substraitExprName: String, childTransformer: ExpressionTransformer, ordinal: Int, original: GetStructField): ExpressionTransformer

    Generate an ExpressionTransformer to transform GetStructFiled expression.

    Generate an ExpressionTransformer to transform GetStructFiled expression.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

28.  def genHashAggregateExecTransformer(requiredChildDistributionExpressions: Option[Seq[Expression]], groupingExpressions: Seq[NamedExpression], aggregateExpressions: Seq[AggregateExpression], aggregateAttributes: Seq[Attribute], initialInputBufferOffset: Int, resultExpressions: Seq[NamedExpression], child: SparkPlan): HashAggregateExecBaseTransformer

    Generate HashAggregateExecTransformer.

    Generate HashAggregateExecTransformer.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

29.  def genHashExpressionTransformer(substraitExprName: String, exprs: Seq[ExpressionTransformer], original: Expression): ExpressionTransformer

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

30.  def genHiveTableScanExecTransformer(plan: SparkPlan): HiveTableScanExecTransformer

    Definition Classes

    SparkPlanExecApi

31.  def genInjectedFunctions(): Seq[(FunctionIdentifier, ExpressionInfo, FunctionBuilder)]

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

32.  def genMd5Transformer(substraitExprName: String, child: ExpressionTransformer, original: Md5): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

33.  def genNamedStructTransformer(substraitExprName: String, children: Seq[ExpressionTransformer], original: CreateNamedStruct, attributeSeq: Seq[Attribute]): ExpressionTransformer

    Generate an expression transformer to transform NamedStruct to Substrait.

    Generate an expression transformer to transform NamedStruct to Substrait.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

34.  def genRandTransformer(substraitExprName: String, explicitSeed: ExpressionTransformer, original: Rand): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

35.  def genRowToColumnarExec(child: SparkPlan): RowToColumnarExecBase

    Generate RowToColumnarExec.

    Generate RowToColumnarExec.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

36.  def genSha1Transformer(substraitExprName: String, child: ExpressionTransformer, original: Sha1): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

37.  def genSha2Transformer(substraitExprName: String, left: ExpressionTransformer, right: ExpressionTransformer, original: Sha2): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

38.  def genShuffleDependency(rdd: RDD[ColumnarBatch], childOutputAttributes: Seq[Attribute], projectOutputAttributes: Seq[Attribute], newPartitioning: Partitioning, serializer: Serializer, writeMetrics: Map[String, SQLMetric], metrics: Map[String, SQLMetric]): ShuffleDependency[Int, ColumnarBatch, ColumnarBatch]

    Generate ShuffleDependency for ColumnarShuffleExchangeExec.

    Generate ShuffleDependency for ColumnarShuffleExchangeExec.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

39.  def genShuffledHashJoinExecTransformer(leftKeys: Seq[Expression], rightKeys: Seq[Expression], joinType: JoinType, buildSide: BuildSide, condition: Option[Expression], left: SparkPlan, right: SparkPlan, isSkewJoin: Boolean): ShuffledHashJoinExecTransformerBase

    Generate ShuffledHashJoinExecTransformer.

    Generate ShuffledHashJoinExecTransformer.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

40.  def genSizeExpressionTransformer(substraitExprName: String, child: ExpressionTransformer, original: Size): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

41.  def genStringLocateTransformer(substraitExprName: String, first: ExpressionTransformer, second: ExpressionTransformer, third: ExpressionTransformer, original: StringLocate): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

42.  def genStringSplitTransformer(substraitExprName: String, srcExpr: ExpressionTransformer, regexExpr: ExpressionTransformer, limitExpr: ExpressionTransformer, original: StringSplit): ExpressionTransformer

    Generate StringSplit transformer.

    Generate StringSplit transformer.

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

43.  def genStringTranslateTransformer(substraitExprName: String, srcExpr: ExpressionTransformer, matchingExpr: ExpressionTransformer, replaceExpr: ExpressionTransformer, original: StringTranslate): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

44.  def genTruncTimestampTransformer(substraitExprName: String, format: ExpressionTransformer, timestamp: ExpressionTransformer, timeZoneId: Option[String], original: TruncTimestamp): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

45.  def genUnixTimestampTransformer(substraitExprName: String, timeExp: ExpressionTransformer, format: ExpressionTransformer, original: ToUnixTimestamp): ExpressionTransformer

    Definition Classes

    SparkPlanExecApi

46.  def genWindowFunctionsNode(windowExpression: Seq[NamedExpression], windowExpressionNodes: List[WindowFunctionNode], originalInputAttributes: Seq[Attribute], args: Map[String, Long]): Unit

    Definition Classes

    SparkPlanExecApi

47.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

48.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

49.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

50.  def joinFallback(JoinType: JoinType, leftOutputSet: AttributeSet, right: AttributeSet, condition: Option[Expression]): Boolean

    Definition Classes

    SparkPlanExecApi

51.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

52.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

53.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

54.  def rewriteSpillPath(path: String): String

    Definition Classes

    SparkPlanExecApiImpl → SparkPlanExecApi

55.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

56.  def toString(): String

    Definition Classes

    AnyRef → Any

57.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

58.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

59.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()