org.apache.hadoop.hive.ql.parse

Class ImportSemanticAnalyzer

java.lang.Object

org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer

public class ImportSemanticAnalyzer
extends BaseSemanticAnalyzer

ImportSemanticAnalyzer.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

BaseSemanticAnalyzer.AnalyzeRewriteContext, BaseSemanticAnalyzer.TableSpec

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

acidFileSinks, cacheUsage, cContext, columnAccessInfo, conf, console, ctx, db, fetchTask, idToTableNameMap, inputs, linfo, outputs, prepareQuery, queryProperties, queryState, rootTasks, STATIC_LOG, tableAccessInfo, transactionalInQuery, txnManager, updateColumnAccessInfo, userSuppliedFunctions

Constructor Summary

Constructors

Constructor and Description
ImportSemanticAnalyzer(QueryState queryState)

Method Summary

Modifier and Type	Method and Description
void	analyzeInternal(ASTNode ast)
static void	checkTargetLocationEmpty(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path targetPath, ReplicationSpec replicationSpec, org.slf4j.Logger logger)
static Table	createNewTableMetadataObject(ImportTableDesc tblDesc, boolean isRepl)
boolean	existsTable()
static boolean	isPartitioned(ImportTableDesc tblDesc)
static String	partSpecToString(Map<String,String> partSpec)
static boolean	prepareImport(boolean isImportCmd, boolean isLocationSet, boolean isExternalSet, boolean isPartSpecSet, boolean waitOnPrecursor, String parsedLocation, String parsedTableName, String overrideDBName, LinkedHashMap<String,String> parsedPartSpec, String fromLocn, EximUtil.SemanticAnalyzerWrapperContext x, UpdatedMetaDataTracker updatedMetadata, HiveTxnManager txnMgr, long writeId, MetaData rv) The same code is used from both the "repl load" as well as "import".
static boolean	prepareImport(boolean isImportCmd, boolean isLocationSet, boolean isExternalSet, boolean isPartSpecSet, boolean waitOnPrecursor, String parsedLocation, String parsedTableName, String overrideDBName, LinkedHashMap<String,String> parsedPartSpec, String fromLocn, EximUtil.SemanticAnalyzerWrapperContext x, UpdatedMetaDataTracker updatedMetadata, HiveTxnManager txnMgr, long writeId, MetaData rv, String dumpRoot, ReplicationMetricCollector metricCollector)
static void	setupDeferredContextFromMetadata(DeferredWorkContext deferredContext)
static Table	tableIfExists(ImportTableDesc tblDesc, Hive db) Utility method that returns a table if one corresponding to the destination tblDesc is found.

Methods inherited from class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer

addPropertyReadEntry, analyze, analyzeStoredAdDirs, charSetString, checkColumnName, constructListBucketingCtx, createFetchTask, createHiveDB, endAnalysis, escapeSQLString, executeUnParseTranslations, findTabRefIdxs, getAcidAnalyzeTable, getAcidDdlDesc, getAcidFileSinks, getAllInputs, getAllOutputs, getAllRootTasks, getAutoCommitValue, getCacheUsage, getCboInfo, getColumnAccessInfo, getColumnNames, getColumnNamesOrder, getColumns, getColumns, getColumns, getCtx, getDatabase, getDatabase, getDataConnector, getDataConnector, getDb, getDbTableNamePair, getFetchTask, getFullTableNameForSQL, getIdToTableNameMap, getInputs, getLineageInfo, getOutputs, getParseContext, getPartitionSpecs, getPartSpec, getProps, getQualifiedTableName, getQualifiedTableName, getQueryProperties, getQueryState, getResultSchema, getRootTasks, getSimpleTableNameBase, getTable, getTable, getTable, getTable, getTable, getTable, getTableAccessInfo, getTableAlias, getTxnMgr, getTypeStringFromAST, getUnescapedName, getUnescapedName, getUnescapedUnqualifiedTableName, getUpdateColumnAccessInfo, getUserSuppliedFunctions, getValidatedPartSpec, hasTransactionalInQuery, init, initCtx, isPrepareQuery, isValidPrefixSpec, processOrderSpec, raiseWrongType, readProps, reset, setAutoCommitValue, setCacheUsage, setColumnAccessInfo, setFetchTask, setLineageInfo, setTableAccessInfo, setUpdateColumnAccessInfo, skipAuthorization, startAnalysis, stripQuotes, toReadEntity, toReadEntity, toReadEntity, toWriteEntity, toWriteEntity, toWriteEntity, tryQualifyPath, unescapeIdentifier, unescapeSQLString, validate, validatePartColumnType, validatePartSpec, validateUnsupportedPartitionClause

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ImportSemanticAnalyzer

public ImportSemanticAnalyzer(QueryState queryState)
                       throws SemanticException

Throws:

SemanticException

Method Detail

existsTable

public boolean existsTable()

analyzeInternal

public void analyzeInternal(ASTNode ast)
                     throws SemanticException

Specified by:

analyzeInternal in class BaseSemanticAnalyzer

Throws:

SemanticException

prepareImport

public static boolean prepareImport(boolean isImportCmd,
                                    boolean isLocationSet,
                                    boolean isExternalSet,
                                    boolean isPartSpecSet,
                                    boolean waitOnPrecursor,
                                    String parsedLocation,
                                    String parsedTableName,
                                    String overrideDBName,
                                    LinkedHashMap<String,String> parsedPartSpec,
                                    String fromLocn,
                                    EximUtil.SemanticAnalyzerWrapperContext x,
                                    UpdatedMetaDataTracker updatedMetadata,
                                    HiveTxnManager txnMgr,
                                    long writeId,
                                    MetaData rv)
                             throws IOException,
                                    org.apache.hadoop.hive.metastore.api.MetaException,
                                    HiveException,
                                    URISyntaxException

The same code is used from both the "repl load" as well as "import". Given that "repl load" now supports two modes "repl load dbName [location]" and "repl load [location]" in which case the database name has to be taken from the table metadata by default and then over-ridden if something specified on the command line.

hence for import to work correctly we have to pass in the sessionState default Db via the parsedDbName parameter

Throws:

IOException

org.apache.hadoop.hive.metastore.api.MetaException

HiveException

URISyntaxException

prepareImport

public static boolean prepareImport(boolean isImportCmd,
                                    boolean isLocationSet,
                                    boolean isExternalSet,
                                    boolean isPartSpecSet,
                                    boolean waitOnPrecursor,
                                    String parsedLocation,
                                    String parsedTableName,
                                    String overrideDBName,
                                    LinkedHashMap<String,String> parsedPartSpec,
                                    String fromLocn,
                                    EximUtil.SemanticAnalyzerWrapperContext x,
                                    UpdatedMetaDataTracker updatedMetadata,
                                    HiveTxnManager txnMgr,
                                    long writeId,
                                    MetaData rv,
                                    String dumpRoot,
                                    ReplicationMetricCollector metricCollector)
                             throws IOException,
                                    org.apache.hadoop.hive.metastore.api.MetaException,
                                    HiveException,
                                    URISyntaxException

Throws:

IOException

org.apache.hadoop.hive.metastore.api.MetaException

HiveException

URISyntaxException

setupDeferredContextFromMetadata

public static void setupDeferredContextFromMetadata(DeferredWorkContext deferredContext)
                                             throws HiveException

Throws:

HiveException

checkTargetLocationEmpty

public static void checkTargetLocationEmpty(org.apache.hadoop.fs.FileSystem fs,
                                            org.apache.hadoop.fs.Path targetPath,
                                            ReplicationSpec replicationSpec,
                                            org.slf4j.Logger logger)
                                     throws IOException,
                                            SemanticException

Throws:

IOException

SemanticException

partSpecToString

public static String partSpecToString(Map<String,String> partSpec)

createNewTableMetadataObject

public static Table createNewTableMetadataObject(ImportTableDesc tblDesc,
                                                 boolean isRepl)
                                          throws SemanticException

Throws:

SemanticException

isPartitioned

public static boolean isPartitioned(ImportTableDesc tblDesc)

tableIfExists

public static Table tableIfExists(ImportTableDesc tblDesc,
                                  Hive db)
                           throws HiveException

Utility method that returns a table if one corresponding to the destination tblDesc is found. Returns null if no such table is found.

Throws:

HiveException