| Package | Description |
|---|---|
| org.apache.hadoop.hive.ql.io |
| Modifier and Type | Class and Description |
|---|---|
static class |
AcidUtils.HdfsDirSnapshotImpl |
| Modifier and Type | Method and Description |
|---|---|
static Map<org.apache.hadoop.fs.Path,AcidUtils.HdfsDirSnapshot> |
AcidUtils.getHdfsDirSnapshots(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path path) |
static Map<org.apache.hadoop.fs.Path,AcidUtils.HdfsDirSnapshot> |
AcidUtils.getHdfsDirSnapshotsForCleaner(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path path)
In case of the cleaner, we don't need to go into file level, it is enough to collect base/delta/deletedelta directories.
|
| Modifier and Type | Method and Description |
|---|---|
static boolean |
AcidUtils.MetaDataFile.isRawFormat(org.apache.hadoop.fs.Path baseOrDeltaDir,
org.apache.hadoop.fs.FileSystem fs,
AcidUtils.HdfsDirSnapshot dirSnapshot)
Checks if the files in base/delta dir are a result of Load Data/Add Partition statement
and thus do not have ROW_IDs embedded in the data.
|
| Modifier and Type | Method and Description |
|---|---|
static AcidDirectory |
AcidUtils.getAcidState(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path candidateDirectory,
org.apache.hadoop.conf.Configuration conf,
ValidWriteIdList writeIdList,
Ref<Boolean> useFileIds,
boolean ignoreEmptyFiles,
Map<org.apache.hadoop.fs.Path,AcidUtils.HdfsDirSnapshot> dirSnapshots)
GetAcidState implementation which uses the provided dirSnapshot.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.