org.apache.hadoop.hive.ql.txn.compactor

Class StatsUpdater

java.lang.Object

org.apache.hadoop.hive.ql.txn.compactor.StatsUpdater

public final class StatsUpdater
extends Object

Updates table/partition statistics. Intended to run after a successful compaction.

Constructor Summary

Constructors

Constructor and Description
StatsUpdater()

Method Summary

Modifier and Type

Method and Description

void

gatherStats(CompactionInfo ci, HiveConf conf, String userName, String compactionQueueName, IMetaStoreClient msc) This doesn't throw any exceptions because we don't want the Compaction to appear as failed if stats gathering fails since this prevents Cleaner from doing it's job and if there are multiple failures, auto initiated compactions will stop which leads to problems that are much worse than stale stats.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StatsUpdater

public StatsUpdater()

Method Detail

gatherStats

public void gatherStats(CompactionInfo ci,
                        HiveConf conf,
                        String userName,
                        String compactionQueueName,
                        IMetaStoreClient msc)

This doesn't throw any exceptions because we don't want the Compaction to appear as failed if stats gathering fails since this prevents Cleaner from doing it's job and if there are multiple failures, auto initiated compactions will stop which leads to problems that are much worse than stale stats. todo: longer term we should write something COMPACTION_QUEUE.CQ_META_INFO. This is a binary field so need to figure out the msg format and how to surface it in SHOW COMPACTIONS, etc

Parameters:

ci - Information about the compaction being run

conf - The hive configuration object

userName - The user to run the statistic collection with

compactionQueueName - The name of the compaction queue