org.apache.hadoop.hive.ql.txn.compactor

Class QueryCompactor

java.lang.Object

org.apache.hadoop.hive.ql.txn.compactor.QueryCompactor

All Implemented Interfaces:

Compactor

public abstract class QueryCompactor
extends Object
implements Compactor

Common interface for query based compactions.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	QueryCompactor.Util Collection of some helper functions.

Field Summary

Fields inherited from interface org.apache.hadoop.hive.ql.txn.compactor.Compactor

FINAL_LOCATION

Constructor Summary

Constructors

Constructor and Description
QueryCompactor()

Method Summary

Modifier and Type	Method and Description
protected void	commitCompaction(String dest, String tmpTableName, HiveConf conf, ValidWriteIdList actualWriteIds, long compactorTxnId) This is the final step of the compaction, which can vary based on compaction type.
protected String	getTempTableName(org.apache.hadoop.hive.metastore.api.Table table)
protected SessionState	setupQueryCompactionSession(HiveConf conf, CompactionInfo compactionInfo, Map<String,String> tblProperties)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.txn.compactor.Compactor

getCompactorTxnId, run

Constructor Detail

QueryCompactor

public QueryCompactor()

Method Detail

commitCompaction

protected void commitCompaction(String dest,
                                String tmpTableName,
                                HiveConf conf,
                                ValidWriteIdList actualWriteIds,
                                long compactorTxnId)
                         throws IOException,
                                HiveException

This is the final step of the compaction, which can vary based on compaction type. Usually this involves some file operation.

Parameters:

dest - The final directory; basically an SD directory.

tmpTableName - The name of the temporary table.

conf - hive configuration.

actualWriteIds - valid write Ids used to fetch the high watermark Id.

compactorTxnId - transaction, that the compacter started.

Throws:

IOException - failed to execute file system operation.

HiveException - failed to execute file operation within hive.

setupQueryCompactionSession

protected SessionState setupQueryCompactionSession(HiveConf conf,
                                                   CompactionInfo compactionInfo,
                                                   Map<String,String> tblProperties)

getTempTableName

protected String getTempTableName(org.apache.hadoop.hive.metastore.api.Table table)