Packages

c

com.nvidia.spark.rapids

StreamSidePartitioner

class StreamSidePartitioner extends JoinPartitioner

Join partitioner for the stream side of a large join.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamSidePartitioner
  2. JoinPartitioner
  3. AutoCloseable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamSidePartitioner(numPartitions: Int, emptyBuildPartitions: BitSet, iter: Iterator[ColumnarBatch], streamTypes: Array[DataType], boundStreamKeys: Seq[Expression], metrics: Map[String, GpuMetric])

    numPartitions

    number of partitions being used in the join

    emptyBuildPartitions

    BitSet indicating which build side partitions are empty

    iter

    iterator of stream side batches

    streamTypes

    schema of the stream side batches

    boundStreamKeys

    bound join key expressions for the stream side

    metrics

    metrics to update

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def addPartition(partIndex: Int, ct: ContiguousTable): Unit

    Adds a batch associated with a partition.

    Adds a batch associated with a partition.

    partIndex

    index of the partition

    ct

    contiguous table to add to the specified partition

    Attributes
    protected
    Definition Classes
    StreamSidePartitionerJoinPartitioner
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. def close(): Unit
    Definition Classes
    StreamSidePartitionerJoinPartitioner → AutoCloseable
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def hasInputBatches: Boolean
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. val opTime: GpuMetric
    Attributes
    protected
    Definition Classes
    JoinPartitioner
  19. def partitionBatch(inputBatch: ColumnarBatch): Unit

    Hash partitions a batch in preparation for performing a sub-join.

    Hash partitions a batch in preparation for performing a sub-join. The input batch will be closed by this method.

    Attributes
    protected
    Definition Classes
    JoinPartitioner
  20. def partitionNextBatch(): Unit
  21. val partitions: Array[JoinPartition]
    Attributes
    protected
    Definition Classes
    JoinPartitioner
  22. def releasePartitions(partIndices: BitSet): Array[SpillableColumnarBatch]
  23. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  24. def toString(): String
    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from JoinPartitioner

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped