| Package | Description |
|---|---|
| org.apache.hadoop.hive.ql.io | |
| org.apache.hadoop.hive.ql.txn.compactor |
| Modifier and Type | Method and Description |
|---|---|
static AcidDirectory |
AcidUtils.getAcidState(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path candidateDirectory,
org.apache.hadoop.conf.Configuration conf,
ValidWriteIdList writeIdList,
Ref<Boolean> useFileIds,
boolean ignoreEmptyFiles)
Get the ACID state of the given directory.
|
static AcidDirectory |
AcidUtils.getAcidState(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path candidateDirectory,
org.apache.hadoop.conf.Configuration conf,
ValidWriteIdList writeIdList,
Ref<Boolean> useFileIds,
boolean ignoreEmptyFiles,
Map<org.apache.hadoop.fs.Path,AcidUtils.HdfsDirSnapshot> dirSnapshots)
GetAcidState implementation which uses the provided dirSnapshot.
|
static AcidDirectory |
AcidUtils.getAcidStateFromCache(Supplier<org.apache.hadoop.fs.FileSystem> fileSystem,
org.apache.hadoop.fs.Path candidateDirectory,
org.apache.hadoop.conf.Configuration conf,
ValidWriteIdList writeIdList,
Ref<Boolean> useFileIds,
boolean ignoreEmptyFiles)
Tries to get directory details from cache.
|
| Modifier and Type | Method and Description |
|---|---|
protected boolean |
CompactorThread.isMinorCompactionSupported(Map<String,String> tblproperties,
AcidDirectory dir)
Check for that special case when minor compaction is supported or not.
|
static boolean |
Worker.needsCleaning(AcidDirectory dir,
org.apache.hadoop.hive.metastore.api.StorageDescriptor sd)
Check for obsolete directories, and return true if any exist and Cleaner should be
run.
|
void |
CompactorMR.run(HiveConf conf,
String jobName,
org.apache.hadoop.hive.metastore.api.Table t,
org.apache.hadoop.hive.metastore.api.Partition p,
org.apache.hadoop.hive.metastore.api.StorageDescriptor sd,
ValidWriteIdList writeIds,
CompactionInfo ci,
IMetaStoreClient msc,
AcidDirectory dir)
Run Compaction which may consist of several jobs on the cluster.
|
Copyright © 2022 The Apache Software Foundation. All rights reserved.