org.apache.hadoop.hive.ql.parse

Class CalcitePlanner

java.lang.Object

org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

org.apache.hadoop.hive.ql.parse.CalcitePlanner

Direct Known Subclasses:

AlterMaterializedViewRebuildAnalyzer, PrepareStatementAnalyzer, RewriteSemanticAnalyzer

public class CalcitePlanner
extends SemanticAnalyzer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CalcitePlanner.ASTSearcher
class	CalcitePlanner.CalcitePlannerAction Code responsible for Calcite plan generation and optimization.
protected static class	CalcitePlanner.InputContext Contains information useful to decorrelate queries.
protected static class	CalcitePlanner.PreCboCtx The context that doPhase1 uses to populate information pertaining to CBO (currently, this is used for CTAS and insert-as-select).

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

SemanticAnalyzer.GenericUDAFInfo, SemanticAnalyzer.MaterializationRebuildMode

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

BaseSemanticAnalyzer.AnalyzeRewriteContext, BaseSemanticAnalyzer.TableSpec

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

aliasToCTEs, analyzeRewrite, ast, autogenColAliasPrfxLbl, createVwDesc, defaultJoinMerge, disableJoinMerge, DUMMY_DATABASE, DUMMY_TABLE, forViewCreation, mvRebuildDbName, mvRebuildMode, mvRebuildName, opParseCtx, originalResultSchema, prunedPartitions, resultSchema, SUBQUERY_TAG_1, SUBQUERY_TAG_2, topOps, topOpsCopy, unparseTranslator, VALUES_TMP_TABLE_NAME_PREFIX, viewSelect

Fields inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

acidFileSinks, cacheUsage, cContext, columnAccessInfo, conf, console, ctx, db, fetchTask, idToTableNameMap, inputs, linfo, LOG, outputs, prepareQuery, queryProperties, queryState, rootTasks, STATIC_LOG, tableAccessInfo, transactionalInQuery, txnManager, updateColumnAccessInfo

Constructor Summary

Constructors

Constructor and Description
CalcitePlanner(QueryState queryState)

Method Summary

Modifier and Type	Method and Description
void	analyzeInternal(ASTNode ast)
static org.apache.calcite.plan.RelOptPlanner	createPlanner(HiveConf conf)
protected org.apache.calcite.tools.Frameworks.PlannerAction<org.apache.calcite.rel.RelNode>	createPlannerAction(Map<String,PrunedPartitionList> partitionCache, StatsSource statsSource, ColumnAccessInfo columnAccessInfo)
protected ASTNode	fixUpAfterCbo(ASTNode originalAst, ASTNode newAst, CalcitePlanner.PreCboCtx cboCtx)
org.apache.calcite.rel.RelNode	genLogicalPlan(ASTNode ast) This method is useful if we want to obtain the logical plan after being parsed and optimized by Calcite.
String	getOptimizedSql(org.apache.calcite.rel.RelNode optimizedOptiqPlan) Get SQL rewrite for a Calcite logical plan
protected Table	getTableObjectByName(String tabName, boolean throwException)
void	resetCalciteConfiguration()
static void	warmup() This method can be called at startup time to pre-register all the additional Hive classes (compared to Calcite core classes) that may be visited during the planning phase in the metadata providers and the field trimmer.

Methods inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

addPartitionColsToInsert, addPartitionColsToInsert, allowOutputMultipleTimes, analyzeCreateView, compilePlan, enableColumnStatsCollecting, executeUnparseTranlations, forViewCreation, generateErrorMessage, genExprNodeDesc, genFileSinkPlan, getAcidAnalyzeTable, getAliasId, getAllInputs, getAllOutputs, getAllRootTasks, getColNameToDefaultValueMap, getColumnInternalName, getDefaultConstraints, getDummyTable, getFullTableNameForSQL, getGenericUDAFEvaluator, getGenericUDAFEvaluator2, getGenericUDAFInfo, getGenericUDAFInfo2, getInvalidAutomaticRewritingMaterializationReason, getInvalidResultCacheReason, getLoadFileWork, getLoadTableWork, getOpContext, getOriginalResultSchema, getParseContext, getQB, getResultSchema, getSinkOp, getTableObjectByName, getTargetTable, getTopOps, getViewAliasToInput, groupByDescModeToUDAFMode, hasGroupBySibling, init, isConstantParameterInAggregationParameters, isInsertInto, isSelectDistinct, isValidAutomaticRewritingMaterialization, isValidQueryCaching, parseSelect, processNoScanCommand, processTableColumnNames, reset, rewriteGroupingFunctionAST, saveViewDefinition, setAST, setBit, setInvalidAutomaticRewritingMaterializationReason, setInvalidResultCacheReason, setLoadFileWork, setLoadTableWork, startAnalysis, translateFieldDesc, updating, validate

Methods inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

addPropertyReadEntry, analyze, analyzeStoredAdDirs, charSetString, checkColumnName, constructListBucketingCtx, createFetchTask, createHiveDB, endAnalysis, escapeSQLString, findTabRefIdxs, getAcidDdlDesc, getAcidFileSinks, getAutoCommitValue, getCacheUsage, getCboInfo, getColumnAccessInfo, getColumnNames, getColumnNamesOrder, getColumns, getColumns, getColumns, getCtx, getDatabase, getDatabase, getDataConnector, getDataConnector, getDb, getDbTableNamePair, getFetchTask, getIdToTableNameMap, getInputs, getLineageInfo, getOutputs, getPartitionSpecs, getPartSpec, getProps, getQualifiedTableName, getQualifiedTableName, getQueryProperties, getQueryState, getRootTasks, getSimpleTableNameBase, getTable, getTable, getTable, getTable, getTable, getTable, getTableAccessInfo, getTableAlias, getTxnMgr, getTypeStringFromAST, getUnescapedName, getUnescapedName, getUnescapedUnqualifiedTableName, getUpdateColumnAccessInfo, getValidatedPartSpec, hasTransactionalInQuery, initCtx, isPrepareQuery, isValidPrefixSpec, raiseWrongType, readProps, setAutoCommitValue, setCacheUsage, setColumnAccessInfo, setFetchTask, setLineageInfo, setTableAccessInfo, setUpdateColumnAccessInfo, skipAuthorization, stripQuotes, toReadEntity, toReadEntity, toReadEntity, toWriteEntity, toWriteEntity, toWriteEntity, tryQualifyPath, unescapeIdentifier, unescapeSQLString, validatePartColumnType, validatePartSpec, validateUnsupportedPartitionClause

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CalcitePlanner

public CalcitePlanner(QueryState queryState)
               throws SemanticException

Throws:

SemanticException

Method Detail

resetCalciteConfiguration

public void resetCalciteConfiguration()

analyzeInternal

public void analyzeInternal(ASTNode ast)
                     throws SemanticException

Overrides:

analyzeInternal in class SemanticAnalyzer

Throws:

SemanticException

genLogicalPlan

public org.apache.calcite.rel.RelNode genLogicalPlan(ASTNode ast)
                                              throws SemanticException

This method is useful if we want to obtain the logical plan after being parsed and optimized by Calcite.

Returns:

the Calcite plan for the query, null if it could not be generated

Throws:

SemanticException

createPlanner

public static org.apache.calcite.plan.RelOptPlanner createPlanner(HiveConf conf)

fixUpAfterCbo

protected ASTNode fixUpAfterCbo(ASTNode originalAst,
                                ASTNode newAst,
                                CalcitePlanner.PreCboCtx cboCtx)
                         throws SemanticException

Throws:

SemanticException

createPlannerAction

protected org.apache.calcite.tools.Frameworks.PlannerAction<org.apache.calcite.rel.RelNode> createPlannerAction(Map<String,PrunedPartitionList> partitionCache,
                                                                                                                StatsSource statsSource,
                                                                                                                ColumnAccessInfo columnAccessInfo)

getOptimizedSql

public String getOptimizedSql(org.apache.calcite.rel.RelNode optimizedOptiqPlan)

Get SQL rewrite for a Calcite logical plan

Returns:

Optimized SQL text (or null, if failed)

getTableObjectByName

protected Table getTableObjectByName(String tabName,
                                     boolean throwException)
                              throws HiveException

Overrides:

getTableObjectByName in class SemanticAnalyzer

Throws:

HiveException

warmup

public static void warmup()

This method can be called at startup time to pre-register all the additional Hive classes (compared to Calcite core classes) that may be visited during the planning phase in the metadata providers and the field trimmer.