org.apache.hadoop.hive.ql.txn.compactor.service

Class AcidCompactionService

java.lang.Object

org.apache.hadoop.hive.ql.txn.compactor.service.CompactionService

org.apache.hadoop.hive.ql.txn.compactor.service.AcidCompactionService

public class AcidCompactionService
extends CompactionService

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.txn.compactor.service.CompactionService

collectGenericStats, compactorFactory, computeStats, conf, msc

Constructor Summary

Constructors

Constructor and Description
AcidCompactionService(HiveConf conf, IMetaStoreClient msc, CompactorFactory compactorFactory, boolean collectGenericStats, boolean collectMrStats)

Method Summary

Modifier and Type	Method and Description
void	cleanupResultDirs(CompactionInfo ci)
Boolean	compact(org.apache.hadoop.hive.metastore.api.Table table, CompactionInfo ci)
static boolean	needsCleaning(AcidDirectory dir, org.apache.hadoop.hive.metastore.api.StorageDescriptor sd) Check for obsolete directories, and return true if any exist and Cleaner should be run.

Methods inherited from class org.apache.hadoop.hive.ql.txn.compactor.service.CompactionService

failCompactionIfSetForTest, init, isComputeStats, isDynPartAbort, isTableSorted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AcidCompactionService

public AcidCompactionService(HiveConf conf,
                             IMetaStoreClient msc,
                             CompactorFactory compactorFactory,
                             boolean collectGenericStats,
                             boolean collectMrStats)

Method Detail

cleanupResultDirs

public void cleanupResultDirs(CompactionInfo ci)

Specified by:

cleanupResultDirs in class CompactionService

compact

public Boolean compact(org.apache.hadoop.hive.metastore.api.Table table,
                       CompactionInfo ci)
                throws Exception

Specified by:

compact in class CompactionService

Throws:

Exception

needsCleaning

public static boolean needsCleaning(AcidDirectory dir,
                                    org.apache.hadoop.hive.metastore.api.StorageDescriptor sd)

Check for obsolete directories, and return true if any exist and Cleaner should be run. For example if we insert overwrite into a table with only deltas, a new base file with the highest writeId is created so there will be no live delta directories, only obsolete ones. Compaction is not needed, but the cleaner should still be run.

Returns:

true if cleaning is needed