Packages

o

org.apache.spark.sql.delta.skipping

MultiDimClusteringFunctions

object MultiDimClusteringFunctions

Functions for multi-dimensional clustering of the data

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MultiDimClusteringFunctions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hilbert_index(numBits: Int, cols: Column*): Column

    Transforms the provided integer columns into their corresponding position in the hilbert curve for the given dimension.

    Transforms the provided integer columns into their corresponding position in the hilbert curve for the given dimension.

    numBits

    The number of bits to consider in each column.

    cols

    The integer columns to map to the curve.

    See also

    https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=bfd6d94c98627756989b0147a68b7ab1f881a0d6

    https://en.wikipedia.org/wiki/Hilbert_curve

  12. def interleave_bits(cols: Column*): Column

    Interleaves the bits of its input data in a round-robin fashion.

    Interleaves the bits of its input data in a round-robin fashion.

    If the input data is seen as a series of multidimensional points, this function computes the corresponding Z-values, in a way that's preserving data locality: input points that are close in the multidimensional space will be mapped to points that are close on the Z-order curve.

    The returned value is a byte array where the size of the array is 4 * num of input columns.

    Note

    Only supports input expressions of type Int for now.

    See also

    https://en.wikipedia.org/wiki/Z-order_curve

  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. def range_partition_id(col: Column, numPartitions: Int): Column

    Conceptually range-partitions the domain of values of the given column into numPartitions partitions and computes the partition number that every value of that column corresponds to.

    Conceptually range-partitions the domain of values of the given column into numPartitions partitions and computes the partition number that every value of that column corresponds to. One can think of this as an approximate rank() function.

    Ex. For a column with values (0, 1, 3, 15, 36, 99) and numPartitions = 3 returns partition range ids as (0, 0, 1, 1, 2, 2).

  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped