org.apache.hadoop.hive.ql.parse

Class MergeSemanticAnalyzer

java.lang.Object

org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

org.apache.hadoop.hive.ql.parse.CalcitePlanner

org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer<MergeStatement>

org.apache.hadoop.hive.ql.parse.MergeSemanticAnalyzer

public class MergeSemanticAnalyzer
extends RewriteSemanticAnalyzer<MergeStatement>

A subclass of the SemanticAnalyzer that just handles merge statements. It works by rewriting the updates and deletes into insert statements (since they are actually inserts) and then doing some patch up to make them work as merges instead.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.CalcitePlanner

CalcitePlanner.ASTSearcher, CalcitePlanner.CalcitePlannerAction, CalcitePlanner.InputContext, CalcitePlanner.PreCboCtx

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

SemanticAnalyzer.GenericUDAFInfo, SemanticAnalyzer.MaterializationRebuildMode

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

BaseSemanticAnalyzer.AnalyzeRewriteContext, BaseSemanticAnalyzer.TableSpec

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer

LOG, useSuper

Fields inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

aliasToCTEs, analyzeRewrite, ast, autogenColAliasPrfxLbl, createVwDesc, defaultJoinMerge, disableJoinMerge, DUMMY_DATABASE, DUMMY_TABLE, forViewCreation, mvRebuildMode, opParseCtx, originalResultSchema, prunedPartitions, resultSchema, SUBQUERY_TAG_1, SUBQUERY_TAG_2, topOps, topOpsCopy, unparseTranslator, VALUES_TMP_TABLE_NAME_PREFIX, viewSelect

Fields inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

acidFileSinks, cacheUsage, cContext, columnAccessInfo, conf, console, ctx, db, fetchTask, idToTableNameMap, inputs, linfo, outputs, prepareQuery, queryProperties, queryState, rootTasks, STATIC_LOG, tableAccessInfo, transactionalInQuery, txnManager, updateColumnAccessInfo, userSuppliedFunctions

Method Summary

Modifier and Type	Method and Description
protected boolean	allowOutputMultipleTimes()
void	analyze(ASTNode tree, Table targetTable, ASTNode targetNameNode) Here we take a Merge statement AST and generate a semantically equivalent multi-insert statement to execute.
protected boolean	enableColumnStatsCollecting()
protected String	getMatchedText(ASTNode n) This allows us to take an arbitrary ASTNode and turn it back into SQL that produced it without needing to understand what it is (except for QuotedIdentifiers).
protected String	getSimpleTableName(ASTNode n) Returns the table name to use in the generated query preserving original quotes/escapes if any.
protected ASTNode	getTargetTableNode(ASTNode tree)
protected ASTNode	getWhenClauseOperation(ASTNode whenClause)
protected MergeStatement.DeleteClause	handleDelete(ASTNode whenMatchedDeleteClause, String updateExtraPredicate)
protected boolean	isAliased(ASTNode n)

Methods inherited from class org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer

analyzeInternal, analyzeRewrittenTree, checkValidSetClauseTarget, collectSetColumnsAndExpressions, findLHSofAssignment, getTable, markReadEntityForUpdate, rewriteAndAnalyze, setUpAccessControlInfoForUpdate, updateOutputs, validateTargetTable

Methods inherited from class org.apache.hadoop.hive.ql.parse.CalcitePlanner

createPlanner, createPlannerAction, fixUpAfterCbo, genLogicalPlan, genRexNode, getOptimizedSql, getTableObjectByName, resetCalciteConfiguration, warmup

Methods inherited from class org.apache.hadoop.hive.ql.parse.SemanticAnalyzer

addPartitionColsToInsert, addPartitionColsToInsert, analyzeCreateView, compilePlan, executeUnParseTranslations, forViewCreation, generateErrorMessage, genExprNodeDesc, genFileSinkPlan, getAcidAnalyzeTable, getAliasId, getAllInputs, getAllOutputs, getAllRootTasks, getColNameToDefaultValueMap, getColumnInternalName, getDefaultConstraints, getDummyTable, getGenericUDAFEvaluator, getGenericUDAFEvaluator2, getGenericUDAFInfo, getGenericUDAFInfo2, getInvalidResultCacheReason, getLoadFileWork, getLoadTableWork, getMaterializationValidationResult, getOpContext, getOriginalResultSchema, getParseContext, getQB, getResultSchema, getSinkOp, getTableObjectByName, getTargetTable, getTopOps, getViewAliasToInput, groupByDescModeToUDAFMode, hasGroupBySibling, init, isConstantParameterInAggregationParameters, isInsertInto, isSelectDistinct, isValidQueryCaching, parseSelect, processNoScanCommand, processTableColumnNames, reset, rewriteGroupingFunctionAST, saveViewDefinition, setAST, setBit, setInvalidResultCacheReason, setLoadFileWork, setLoadTableWork, setMaterializationValidationResult, startAnalysis, translateFieldDesc, updating, validate

Methods inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

addPropertyReadEntry, analyze, analyzeStoredAdDirs, charSetString, checkColumnName, constructListBucketingCtx, createFetchTask, createHiveDB, endAnalysis, escapeSQLString, findTabRefIdxs, getAcidDdlDesc, getAcidFileSinks, getAutoCommitValue, getCacheUsage, getCboInfo, getColumnAccessInfo, getColumnNames, getColumnNamesOrder, getColumns, getColumns, getColumns, getCtx, getDatabase, getDatabase, getDataConnector, getDataConnector, getDb, getDbTableNamePair, getFetchTask, getFullTableNameForSQL, getIdToTableNameMap, getInputs, getLineageInfo, getOutputs, getPartitionSpecs, getPartSpec, getProps, getQualifiedTableName, getQualifiedTableName, getQueryProperties, getQueryState, getRootTasks, getSimpleTableNameBase, getTable, getTable, getTable, getTable, getTable, getTable, getTableAccessInfo, getTableAlias, getTxnMgr, getTypeStringFromAST, getUnescapedName, getUnescapedName, getUnescapedUnqualifiedTableName, getUpdateColumnAccessInfo, getUserSuppliedFunctions, getValidatedPartSpec, hasTransactionalInQuery, initCtx, isPrepareQuery, isValidPrefixSpec, processOrderSpec, raiseWrongType, readProps, setAutoCommitValue, setCacheUsage, setColumnAccessInfo, setFetchTask, setLineageInfo, setTableAccessInfo, setUpdateColumnAccessInfo, skipAuthorization, stripQuotes, toReadEntity, toReadEntity, toReadEntity, toWriteEntity, toWriteEntity, toWriteEntity, tryQualifyPath, unescapeIdentifier, unescapeSQLString, validatePartColumnType, validatePartSpec, validateUnsupportedPartitionClause

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getTargetTableNode

protected ASTNode getTargetTableNode(ASTNode tree)

Specified by:

getTargetTableNode in class RewriteSemanticAnalyzer<MergeStatement>

analyze

public void analyze(ASTNode tree,
                    Table targetTable,
                    ASTNode targetNameNode)
             throws SemanticException

Here we take a Merge statement AST and generate a semantically equivalent multi-insert statement to execute. Each Insert leg represents a single WHEN clause. As much as possible, the new SQL statement is made to look like the input SQL statement so that it's easier to map Query Compiler errors from generated SQL to original one this way. The generated SQL is a complete representation of the original input for the same reason. In many places SemanticAnalyzer throws exceptions that contain (line, position) coordinates. If generated SQL doesn't have everything and is patched up later, these coordinates point to the wrong place.

Specified by:

analyze in class RewriteSemanticAnalyzer<MergeStatement>

Throws:

SemanticException

handleDelete

protected MergeStatement.DeleteClause handleDelete(ASTNode whenMatchedDeleteClause,
                                                   String updateExtraPredicate)

Parameters:

updateExtraPredicate - - see notes at caller

getWhenClauseOperation

protected ASTNode getWhenClauseOperation(ASTNode whenClause)

allowOutputMultipleTimes

protected boolean allowOutputMultipleTimes()

Overrides:

allowOutputMultipleTimes in class SemanticAnalyzer

enableColumnStatsCollecting

protected boolean enableColumnStatsCollecting()

Overrides:

enableColumnStatsCollecting in class SemanticAnalyzer

getMatchedText

protected String getMatchedText(ASTNode n)

This allows us to take an arbitrary ASTNode and turn it back into SQL that produced it without needing to understand what it is (except for QuotedIdentifiers).

isAliased

protected boolean isAliased(ASTNode n)

getSimpleTableName

protected String getSimpleTableName(ASTNode n)
                             throws SemanticException

Returns the table name to use in the generated query preserving original quotes/escapes if any.

Throws:

SemanticException

See Also:

BaseSemanticAnalyzer.getFullTableNameForSQL(ASTNode)