org.apache.hadoop.hive.ql.metadata

Class HiveMetaStoreClientWithLocalCache

java.lang.Object

org.apache.hadoop.hive.metastore.HiveMetaStoreClient

org.apache.hadoop.hive.ql.metadata.HiveMetaStoreClientWithLocalCache

All Implemented Interfaces:

AutoCloseable, IMetaStoreClient

Direct Known Subclasses:

SessionHiveMetaStoreClient

public class HiveMetaStoreClientWithLocalCache
extends HiveMetaStoreClient
implements IMetaStoreClient

This class introduces a caching layer in HS2 for metadata for some selected query APIs. It extends HiveMetaStoreClient, and overrides some of its methods to add this feature. Its design is simple, relying on snapshot information being queried to cache and invalidate the metadata. It helps to reduce the time spent in compilation by using HS2 memory more effectively, and it allows to improve HMS throughput for multi-tenant workloads by reducing the number of calls it needs to serve.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static interface	HiveMetaStoreClientWithLocalCache.CacheI Cache interface.
static class	HiveMetaStoreClientWithLocalCache.CacheKey CacheKey objects are used as key for the cache.
protected static class	HiveMetaStoreClientWithLocalCache.CacheWrapper Wrapper to create a cache around a Caffeine Cache.
static class	HiveMetaStoreClientWithLocalCache.KeyType KeyType is used to differentiate the request types.
protected static class	HiveMetaStoreClientWithLocalCache.TableWatermark Internal class to identify uniquely a Table.

Nested classes/interfaces inherited from class org.apache.hadoop.hive.metastore.HiveMetaStoreClient

HiveMetaStoreClient.MetastoreMapIterable<K,V>

Nested classes/interfaces inherited from interface org.apache.hadoop.hive.metastore.IMetaStoreClient

IMetaStoreClient.IncompatibleMetastoreException, IMetaStoreClient.NotificationFilter

Field Summary

Fields inherited from class org.apache.hadoop.hive.metastore.HiveMetaStoreClient

conf, MANUALLY_INITIATED_COMPACTION, RENAME_PARTITION_MAKE_COPY, SKIP_DROP_PARTITION, TEST_VERSION, TRUNCATE_SKIP_DATA_DELETION, VERSION

Constructor Summary

Constructors

Constructor and Description
HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf)
HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf, HiveMetaHookLoader hookLoader)
HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf, HiveMetaHookLoader hookLoader, Boolean allowEmbedded)

Method Summary

Modifier and Type	Method and Description
protected org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult	computePartitionsByNamesFinal(org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst, List<org.apache.hadoop.hive.metastore.api.Partition> partitions, List<org.apache.hadoop.hive.metastore.api.Partition> newPartitions)
protected org.apache.hadoop.hive.metastore.api.TableStatsResult	computeTableColumnStatisticsFinal(org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst, List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> colStats, List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> newColStats)
protected org.apache.hadoop.hive.metastore.api.GetValidWriteIdsResponse	computeValidWriteIdsFinal(org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst, List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds> tblValidWriteIds, List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds> newTblValidWriteIds)
protected org.apache.hadoop.hive.metastore.api.AggrStats	getAggrStatsForInternal(org.apache.hadoop.hive.metastore.api.PartitionsStatsRequest req)
protected org.apache.hadoop.hive.metastore.api.PartitionsByExprResult	getPartitionsByExprInternal(org.apache.hadoop.hive.metastore.api.PartitionsByExprRequest req)
protected org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.Partition>,List<String>>	getPartitionsByNamesCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst, HiveMetaStoreClientWithLocalCache.TableWatermark watermark)
protected org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult	getPartitionsByNamesInternal(org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst)
protected org.apache.hadoop.hive.metastore.api.PartitionsSpecByExprResult	getPartitionsSpecByExprInternal(org.apache.hadoop.hive.metastore.api.PartitionsByExprRequest req)
protected String	getQueryId()
protected org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj>,List<String>>	getTableColumnStatisticsCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst, HiveMetaStoreClientWithLocalCache.TableWatermark watermark)
protected org.apache.hadoop.hive.metastore.api.TableStatsResult	getTableColumnStatisticsInternal(org.apache.hadoop.hive.metastore.api.TableStatsRequest req)
protected org.apache.hadoop.hive.metastore.api.GetTableResult	getTableInternal(org.apache.hadoop.hive.metastore.api.GetTableRequest req)
protected org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds>,List<String>>	getValidWriteIdsCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst)
static void	init(org.apache.hadoop.conf.Configuration conf)
protected List<String>	listPartitionNamesInternal(String catName, String dbName, String tableName, int maxParts)
protected List<org.apache.hadoop.hive.metastore.api.Partition>	loadPartitionsByNamesCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult r, org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst, HiveMetaStoreClientWithLocalCache.TableWatermark watermark)
protected List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj>	loadTableColumnStatisticsCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.TableStatsResult r, org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst, HiveMetaStoreClientWithLocalCache.TableWatermark watermark)
protected List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds>	loadValidWriteIdsCache(HiveMetaStoreClientWithLocalCache.CacheI cache, org.apache.hadoop.hive.metastore.api.GetValidWriteIdsResponse r, org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst)

Methods inherited from class org.apache.hadoop.hive.metastore.HiveMetaStoreClient

abortCompactions, abortTxns, abortTxns, add_partition, add_partition, add_partitions_pspec, add_partitions, add_partitions, addCheckConstraint, addDefaultConstraint, addDynamicPartitions, addDynamicPartitions, addForeignKey, addMasterKey, addNotNullConstraint, addPackage, addPrimaryKey, addReplicationMetrics, addRuntimeStat, addSchemaVersion, addSerDe, addToken, addUniqueConstraint, addWriteIdsToMinHistory, addWriteNotificationLog, addWriteNotificationLogInBatch, allocateTableWriteId, allocateTableWriteId, allocateTableWriteIdsBatch, alter_partition, alter_partition, alter_partition, alter_partition, alter_partitions, alter_partitions, alter_partitions, alter_partitions, alter_table_with_environmentContext, alter_table, alter_table, alter_table, alter_table, alterCatalog, alterDatabase, alterDatabase, alterDataConnector, alterFunction, alterFunction, alterISchema, alterResourcePlan, alterWMPool, alterWMTrigger, appendPartition, appendPartition, appendPartition, appendPartition, appendPartition, appendPartitionByName, appendPartitionByName, buildPartitionsByExprRequest, cacheFileMetadata, cancelDelegationToken, checkLock, clearFileMetadata, close, commitTxn, commitTxn, commitTxnWithKeyValue, compact, compact, compact2, compact2, create_role, create_table, createCatalog, createDatabase, createDataConnector, createFunction, createHttpClientBuilder, createISchema, createOrDropTriggerToPoolMapping, createOrUpdateWMMapping, createResourcePlan, createStoredProcedure, createTable, createTable, createTable, createTableWithConstraints, createType, createWMPool, createWMTrigger, deepCopy, deepCopy, deepCopy, deepCopyFieldSchemas, deepCopyPartitions, deletePartitionColumnStatistics, deletePartitionColumnStatistics, deleteTableColumnStatistics, deleteTableColumnStatistics, drop_role, drop_table_with_environment_context, dropCatalog, dropConstraint, dropConstraint, dropDatabase, dropDatabase, dropDatabase, dropDatabase, dropDataConnector, dropFunction, dropFunction, dropISchema, dropPackage, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartitionByName, dropPartitionByName, dropPartitions, dropPartitions, dropPartitions, dropPartitions, dropResourcePlan, dropSchemaVersion, dropStoredProcedure, dropTable, dropTable, dropTable, dropTable, dropTable, dropTable, dropType, dropWMMapping, dropWMPool, dropWMTrigger, exchange_partition, exchange_partition, exchange_partitions, exchange_partitions, findColumnsWithStats, findNextCompact, findNextCompact, findPackage, fireListenerEvent, flushCache, get_principals_in_role, get_privilege_set, get_role_grants_for_principal, getActiveResourcePlan, getAggrColStatsFor, getAggrColStatsFor, getAggrColStatsFor, getAggrColStatsFor, getAllDatabases, getAllDatabases, getAllDataConnectorNames, getAllFunctions, getAllMaterializedViewObjectsForRewriting, getAllResourcePlans, getAllStoredProcedures, getAllTableConstraints, getAllTables, getAllTables, getAllTokenIdentifiers, getAllWriteEventInfo, getCatalog, getCatalogs, getCheckConstraints, getConfigValue, getConfigValueInternal, getCurrentNotificationEventId, getDatabase, getDatabase, getDatabaseInternal, getDatabases, getDatabases, getDataConnector, getDefaultConstraints, getDelegationToken, getDelegationToken, getFields, getFields, getFieldsRequest, getFileMetadata, getFileMetadataBySarg, getForeignKeys, getForeignKeysInternal, getFunction, getFunction, getFunctions, getFunctions, getISchema, getLatestCommittedCompactionInfo, getLatestTxnIdInConflict, getMasterKeys, getMaterializationInvalidationInfo, getMaterializedViewsForRewriting, getMaterializedViewsForRewriting, getMaxAllocatedWriteId, getMetaConf, getMetastoreDbUuid, getNextNotification, getNextNotification, getNotificationEventsCount, getNotNullConstraints, getNotNullConstraintsInternal, getNumPartitionsByFilter, getNumPartitionsByFilter, getOpenTxns, getPartition, getPartition, getPartition, getPartition, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionRequest, getPartitionsByNames, getPartitionsByNames, getPartitionsByNames, getPartitionsRequest, getPartitionsWithSpecs, getPartitionWithAuthInfo, getPartitionWithAuthInfo, getPrimaryKeys, getPrimaryKeysInternal, getProcessorCapabilities, getProcessorIdentifier, getProperties, getReplicationMetrics, getResourcePlan, getRuntimeStats, getScheduledQuery, getSchema, getSchema, getSchemaAllVersions, getSchemaByCols, getSchemaLatestVersion, getSchemaRequest, getSchemaVersion, getSerDe, getServerVersion, getStoredProcedure, getTable, getTable, getTable, getTable, getTable, getTable, getTable, getTableColumnStatistics, getTableColumnStatistics, getTableColumnStatistics, getTableColumnStatistics, getTableMeta, getTableMeta, getTableObjectsByName, getTableObjectsByName, getTables, getTables, getTables, getTables, getTables, getTablesExt, getToken, getTokenStrForm, getTranslateTableDryrun, getTriggersForResourcePlan, getTTransport, getType, getTypeAll, getUniqueConstraints, getUniqueConstraintsInternal, getValidTxns, getValidTxns, getValidTxns, getValidWriteIdList, getValidWriteIds, getValidWriteIds, getValidWriteIds, getValidWriteIdsInternal, grant_privileges, grant_role, heartbeat, heartbeatLockMaterializationRebuild, heartbeatTxnRange, insertTable, isCompatibleWith, isLocalMetaStore, isPartitionMarkedForEvent, isPartitionMarkedForEvent, isSameConfObj, list_privileges, list_roles, listPackages, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNamesInternal, listPartitionNamesRequest, listPartitionNamesRequestInternal, listPartitions, listPartitions, listPartitions, listPartitions, listPartitionsByExpr, listPartitionsByExpr, listPartitionsByFilter, listPartitionsByFilter, listPartitionSpecs, listPartitionSpecs, listPartitionSpecsByFilter, listPartitionSpecsByFilter, listPartitionsSpecByExpr, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfoInternal, listPartitionsWithAuthInfoInternal, listPartitionsWithAuthInfoRequest, listPartitionsWithAuthInfoRequestInternal, listPartitionValues, listRoleNames, listTableNamesByFilter, listTableNamesByFilter, lock, lockMaterializationRebuild, mapSchemaVersionToSerde, markCleaned, markCompacted, markFailed, markPartitionForEvent, markPartitionForEvent, markRefused, newSynchronizedClient, openTxn, openTxn, openTxns, partitionNameToSpec, partitionNameToVals, putFileMetadata, reconnect, recycleDirToCmPath, refresh_privileges, removeCompactionMetricsData, removeMasterKey, removeToken, renamePartition, renamePartition, renewDelegationToken, replAllocateTableWriteIdsBatch, replOpenTxn, replRollbackTxn, replTableWriteIdState, revoke_privileges, revoke_role, rollbackTxn, rollbackTxn, scheduledQueryMaintenance, scheduledQueryPoll, scheduledQueryProgress, seedTxnId, seedWriteId, setHadoopJobid, setHiveAddedJars, setMetaConf, setPartitionColumnStatistics, setProcessorCapabilities, setProcessorIdentifier, setProperties, setSchemaVersionState, showCompactions, showCompactions, showLocks, showLocks, showTxns, submitForCleanup, tableExists, tableExists, truncateTable, truncateTable, truncateTable, truncateTable, unlock, updateCompactionMetricsData, updateCompactorState, updateCreationMetadata, updateCreationMetadata, updateMasterKey, updatePartitionColumnStatistics, updateTableColumnStatistics, updateTransactionalStatistics, validatePartitionNameCharacters, validateResourcePlan

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.metastore.IMetaStoreClient

abortCompactions, abortTxns, abortTxns, add_partition, add_partitions_pspec, add_partitions, add_partitions, addCheckConstraint, addDefaultConstraint, addDynamicPartitions, addDynamicPartitions, addForeignKey, addMasterKey, addNotNullConstraint, addPackage, addPrimaryKey, addReplicationMetrics, addRuntimeStat, addSchemaVersion, addSerDe, addToken, addUniqueConstraint, addWriteIdsToMinHistory, addWriteNotificationLog, addWriteNotificationLogInBatch, allocateTableWriteId, allocateTableWriteId, allocateTableWriteIdsBatch, alter_partition, alter_partition, alter_partition, alter_partition, alter_partition, alter_partitions, alter_partitions, alter_partitions, alter_partitions, alter_partitions, alter_table_with_environmentContext, alter_table, alter_table, alter_table, alter_table, alter_table, alterCatalog, alterDatabase, alterDatabase, alterDataConnector, alterFunction, alterFunction, alterISchema, alterResourcePlan, alterWMPool, alterWMTrigger, appendPartition, appendPartition, appendPartition, appendPartition, cacheFileMetadata, cancelDelegationToken, checkLock, clearFileMetadata, close, commitTxn, commitTxn, commitTxnWithKeyValue, compact, compact, compact2, compact2, create_role, createCatalog, createDatabase, createDataConnector, createFunction, createISchema, createOrDropTriggerToPoolMapping, createOrUpdateWMMapping, createResourcePlan, createStoredProcedure, createTable, createTable, createTableWithConstraints, createWMPool, createWMTrigger, deletePartitionColumnStatistics, deletePartitionColumnStatistics, deleteTableColumnStatistics, deleteTableColumnStatistics, drop_role, dropCatalog, dropConstraint, dropConstraint, dropDatabase, dropDatabase, dropDatabase, dropDatabase, dropDatabase, dropDatabase, dropDatabase, dropDataConnector, dropFunction, dropFunction, dropISchema, dropPackage, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartition, dropPartitions, dropPartitions, dropPartitions, dropPartitions, dropPartitions, dropPartitions, dropResourcePlan, dropSchemaVersion, dropStoredProcedure, dropTable, dropTable, dropTable, dropTable, dropTable, dropTable, dropTable, dropWMMapping, dropWMPool, dropWMTrigger, exchange_partition, exchange_partition, exchange_partitions, exchange_partitions, findColumnsWithStats, findNextCompact, findNextCompact, findPackage, fireListenerEvent, flushCache, get_principals_in_role, get_privilege_set, get_role_grants_for_principal, getActiveResourcePlan, getAggrColStatsFor, getAggrColStatsFor, getAggrColStatsFor, getAggrColStatsFor, getAllDatabases, getAllDatabases, getAllDataConnectorNames, getAllFunctions, getAllMaterializedViewObjectsForRewriting, getAllResourcePlans, getAllStoredProcedures, getAllTableConstraints, getAllTables, getAllTables, getAllTokenIdentifiers, getAllWriteEventInfo, getCatalog, getCatalogs, getCheckConstraints, getConfigValue, getCurrentNotificationEventId, getDatabase, getDatabase, getDatabases, getDatabases, getDataConnector, getDefaultConstraints, getDelegationToken, getFields, getFields, getFieldsRequest, getFileMetadata, getFileMetadataBySarg, getForeignKeys, getFunction, getFunction, getFunctions, getFunctions, getISchema, getLatestCommittedCompactionInfo, getLatestTxnIdInConflict, getMasterKeys, getMaterializationInvalidationInfo, getMaterializedViewsForRewriting, getMaterializedViewsForRewriting, getMaxAllocatedWriteId, getMetaConf, getMetastoreDbUuid, getNextNotification, getNextNotification, getNotificationEventsCount, getNotNullConstraints, getNumPartitionsByFilter, getNumPartitionsByFilter, getOpenTxns, getPartition, getPartition, getPartition, getPartition, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionColumnStatistics, getPartitionRequest, getPartitionsByNames, getPartitionsByNames, getPartitionsByNames, getPartitionsRequest, getPartitionsWithSpecs, getPartitionWithAuthInfo, getPartitionWithAuthInfo, getPrimaryKeys, getProperties, getReplicationMetrics, getResourcePlan, getRuntimeStats, getScheduledQuery, getSchema, getSchema, getSchemaAllVersions, getSchemaByCols, getSchemaLatestVersion, getSchemaRequest, getSchemaVersion, getSerDe, getServerVersion, getStoredProcedure, getTable, getTable, getTable, getTable, getTable, getTable, getTableColumnStatistics, getTableColumnStatistics, getTableColumnStatistics, getTableColumnStatistics, getTableMeta, getTableMeta, getTableObjectsByName, getTableObjectsByName, getTables, getTables, getTables, getTables, getTables, getTablesExt, getToken, getTokenStrForm, getTranslateTableDryrun, getTriggersForResourcePlan, getUniqueConstraints, getValidTxns, getValidTxns, getValidTxns, getValidWriteIds, getValidWriteIds, getValidWriteIds, grant_privileges, grant_role, heartbeat, heartbeatLockMaterializationRebuild, heartbeatTxnRange, insertTable, isCompatibleWith, isLocalMetaStore, isPartitionMarkedForEvent, isPartitionMarkedForEvent, isSameConfObj, list_privileges, list_roles, listPackages, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNames, listPartitionNamesRequest, listPartitions, listPartitions, listPartitions, listPartitions, listPartitionsByExpr, listPartitionsByExpr, listPartitionsByFilter, listPartitionsByFilter, listPartitionSpecs, listPartitionSpecs, listPartitionSpecsByFilter, listPartitionSpecsByFilter, listPartitionsSpecByExpr, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfo, listPartitionsWithAuthInfoRequest, listPartitionValues, listRoleNames, listTableNamesByFilter, listTableNamesByFilter, lock, lockMaterializationRebuild, mapSchemaVersionToSerde, markCleaned, markCompacted, markFailed, markPartitionForEvent, markPartitionForEvent, markRefused, openTxn, openTxn, openTxns, partitionNameToSpec, partitionNameToVals, putFileMetadata, reconnect, recycleDirToCmPath, refresh_privileges, removeCompactionMetricsData, removeMasterKey, removeToken, renamePartition, renamePartition, renamePartition, renewDelegationToken, replAllocateTableWriteIdsBatch, replOpenTxn, replRollbackTxn, replTableWriteIdState, revoke_privileges, revoke_role, rollbackTxn, rollbackTxn, scheduledQueryMaintenance, scheduledQueryPoll, scheduledQueryProgress, seedTxnId, seedWriteId, setHadoopJobid, setHiveAddedJars, setMetaConf, setPartitionColumnStatistics, setProperties, setSchemaVersionState, showCompactions, showCompactions, showLocks, showLocks, showTxns, submitForCleanup, tableExists, tableExists, truncateTable, truncateTable, truncateTable, truncateTable, unlock, updateCompactionMetricsData, updateCompactorState, updateCreationMetadata, updateCreationMetadata, updateMasterKey, updatePartitionColumnStatistics, updateTableColumnStatistics, updateTransactionalStatistics, validatePartitionNameCharacters, validateResourcePlan

Constructor Detail

HiveMetaStoreClientWithLocalCache

public HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf)
                                  throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

HiveMetaStoreClientWithLocalCache

public HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf,
                                         HiveMetaHookLoader hookLoader)
                                  throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

HiveMetaStoreClientWithLocalCache

public HiveMetaStoreClientWithLocalCache(org.apache.hadoop.conf.Configuration conf,
                                         HiveMetaHookLoader hookLoader,
                                         Boolean allowEmbedded)
                                  throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

Method Detail

init

public static void init(org.apache.hadoop.conf.Configuration conf)

getTableInternal

protected org.apache.hadoop.hive.metastore.api.GetTableResult getTableInternal(org.apache.hadoop.hive.metastore.api.GetTableRequest req)
                                                                        throws org.apache.thrift.TException

Overrides:

getTableInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getPartitionsByExprInternal

protected org.apache.hadoop.hive.metastore.api.PartitionsByExprResult getPartitionsByExprInternal(org.apache.hadoop.hive.metastore.api.PartitionsByExprRequest req)
                                                                                           throws org.apache.thrift.TException

Overrides:

getPartitionsByExprInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

listPartitionNamesInternal

protected List<String> listPartitionNamesInternal(String catName,
                                                  String dbName,
                                                  String tableName,
                                                  int maxParts)
                                           throws org.apache.thrift.TException

Overrides:

listPartitionNamesInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getPartitionsSpecByExprInternal

protected org.apache.hadoop.hive.metastore.api.PartitionsSpecByExprResult getPartitionsSpecByExprInternal(org.apache.hadoop.hive.metastore.api.PartitionsByExprRequest req)
                                                                                                   throws org.apache.thrift.TException

Overrides:

getPartitionsSpecByExprInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getTableColumnStatisticsInternal

protected org.apache.hadoop.hive.metastore.api.TableStatsResult getTableColumnStatisticsInternal(org.apache.hadoop.hive.metastore.api.TableStatsRequest req)
                                                                                          throws org.apache.thrift.TException

Overrides:

getTableColumnStatisticsInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getAggrStatsForInternal

protected org.apache.hadoop.hive.metastore.api.AggrStats getAggrStatsForInternal(org.apache.hadoop.hive.metastore.api.PartitionsStatsRequest req)
                                                                          throws org.apache.thrift.TException

Overrides:

getAggrStatsForInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getPartitionsByNamesInternal

protected org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult getPartitionsByNamesInternal(org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst)
                                                                                                throws org.apache.thrift.TException

Overrides:

getPartitionsByNamesInternal in class HiveMetaStoreClient

Throws:

org.apache.thrift.TException

getQueryId

protected String getQueryId()

getTableColumnStatisticsCache

protected final org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj>,List<String>> getTableColumnStatisticsCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                                                                               org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst,
                                                                                                                                                               HiveMetaStoreClientWithLocalCache.TableWatermark watermark)

loadTableColumnStatisticsCache

protected final List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> loadTableColumnStatisticsCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                              org.apache.hadoop.hive.metastore.api.TableStatsResult r,
                                                                                                              org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst,
                                                                                                              HiveMetaStoreClientWithLocalCache.TableWatermark watermark)

computeTableColumnStatisticsFinal

protected final org.apache.hadoop.hive.metastore.api.TableStatsResult computeTableColumnStatisticsFinal(org.apache.hadoop.hive.metastore.api.TableStatsRequest rqst,
                                                                                                        List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> colStats,
                                                                                                        List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> newColStats)

getPartitionsByNamesCache

protected final org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.Partition>,List<String>> getPartitionsByNamesCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                                                                 org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst,
                                                                                                                                                 HiveMetaStoreClientWithLocalCache.TableWatermark watermark)
                                                                                                                                          throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

loadPartitionsByNamesCache

protected final List<org.apache.hadoop.hive.metastore.api.Partition> loadPartitionsByNamesCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult r,
                                                                                                org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst,
                                                                                                HiveMetaStoreClientWithLocalCache.TableWatermark watermark)

computePartitionsByNamesFinal

protected final org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesResult computePartitionsByNamesFinal(org.apache.hadoop.hive.metastore.api.GetPartitionsByNamesRequest rqst,
                                                                                                              List<org.apache.hadoop.hive.metastore.api.Partition> partitions,
                                                                                                              List<org.apache.hadoop.hive.metastore.api.Partition> newPartitions)
                                                                                                       throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

getValidWriteIdsCache

protected final org.apache.commons.lang3.tuple.Pair<List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds>,List<String>> getValidWriteIdsCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                                                                      org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst)
                                                                                                                                               throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

loadValidWriteIdsCache

protected final List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds> loadValidWriteIdsCache(HiveMetaStoreClientWithLocalCache.CacheI cache,
                                                                                                     org.apache.hadoop.hive.metastore.api.GetValidWriteIdsResponse r,
                                                                                                     org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst)
                                                                                              throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

computeValidWriteIdsFinal

protected final org.apache.hadoop.hive.metastore.api.GetValidWriteIdsResponse computeValidWriteIdsFinal(org.apache.hadoop.hive.metastore.api.GetValidWriteIdsRequest rqst,
                                                                                                        List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds> tblValidWriteIds,
                                                                                                        List<org.apache.hadoop.hive.metastore.api.TableValidWriteIds> newTblValidWriteIds)