org.apache.hadoop.hive.ql.optimizer.calcite.rules

Class HiveRewriteToDataSketchesRules.AbstractRankBasedRewriteRule

java.lang.Object

org.apache.calcite.plan.RelOptRule

org.apache.hadoop.hive.ql.optimizer.calcite.rules.HiveRewriteToDataSketchesRules.AbstractRankBasedRewriteRule

Direct Known Subclasses:

HiveRewriteToDataSketchesRules.CumeDistRewriteRule, HiveRewriteToDataSketchesRules.NTileRewrite, HiveRewriteToDataSketchesRules.RankRewriteRule

Enclosing class:

HiveRewriteToDataSketchesRules

public abstract static class HiveRewriteToDataSketchesRules.AbstractRankBasedRewriteRule
extends org.apache.calcite.plan.RelOptRule

Provides a generic way to rewrite function into using an estimation based on CDF. There are a few methods which could be supported this way: NTILE, CUME_DIST, RANK For example:

   SELECT id, CUME_DIST() OVER (ORDER BY id) FROM sketch_input;
     ⇒ SELECT id, ds_kll_cdf(ds, CAST(id AS FLOAT) )[0]
       FROM sketch_input JOIN (
         SELECT ds_kll_sketch(CAST(id AS FLOAT)) AS ds FROM sketch_input
       ) q;
  

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	HiveRewriteToDataSketchesRules.AbstractRankBasedRewriteRule.AbstractRankBasedRewriteBuilder

Nested classes/interfaces inherited from class org.apache.calcite.plan.RelOptRule

org.apache.calcite.plan.RelOptRule.ConverterRelOptRuleOperand

Field Summary

Fields inherited from class org.apache.calcite.plan.RelOptRule

description, operands, relBuilderFactory

Constructor Summary

Constructors

Constructor and Description
AbstractRankBasedRewriteRule(String sketchType, String description)

Method Summary

Methods inherited from class org.apache.calcite.plan.RelOptRule

any, convert, convert, convertList, convertOperand, convertOperand, equals, equals, getOperand, getOperands, getOutConvention, getOutTrait, hashCode, matches, none, operand, operand, operand, operand, operand, operandJ, operandJ, some, toString, unordered

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

AbstractRankBasedRewriteRule

public AbstractRankBasedRewriteRule(String sketchType,
                                    String description)