case class ClusterByParserUtils(clusterByPlan: ClusterByPlan, delegate: ParserInterface) extends Product with Serializable
Parser utils for parsing a ClusterByPlan and converts it to table properties.
This class will be removed when we integrate with OSS Spark's CLUSTER BY implementation.
- See also
https://github.com/apache/spark/pull/42577
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- ClusterByParserUtils
- Serializable
- Product
- Equals
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Instance Constructors
- new ClusterByParserUtils(clusterByPlan: ClusterByPlan, delegate: ParserInterface)
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- val clusterByPlan: ClusterByPlan
- val delegate: ParserInterface
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def parsePlan(sqlText: String): LogicalPlan
Parse the ClusterByPlan by replacing CLUSTER BY with PARTITIONED BY and leverage Spark SQL parser to perform the validation.
Parse the ClusterByPlan by replacing CLUSTER BY with PARTITIONED BY and leverage Spark SQL parser to perform the validation. After parsing, store the clustering columns in the logical plan's partitioning transforms.
- returns
the logical plan after parsing.
- def productElementNames: Iterator[String]
- Definition Classes
- Product
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()