org.apache.hadoop.hive.ql.io

Class AcidUtils.OrcAcidVersion

java.lang.Object

org.apache.hadoop.hive.ql.io.AcidUtils.OrcAcidVersion

Enclosing class:

AcidUtils

public static final class AcidUtils.OrcAcidVersion
extends Object

Logic related to versioning acid data format. An ACID_FORMAT file is written to each base/delta/delete_delta dir written by a full acid write or compaction. This is the primary mechanism for versioning acid data. Each individual ORC file written stores the current version as a user property in ORC footer. All data files produced by Acid write should have this (starting with Hive 3.0), including those written by compactor. This is more for sanity checking in case someone moved the files around or something like that. Methods for getting/reading the version from files were moved to test class TestTxnCommands which is the only place they are used, in order to keep devs out of temptation, since they access the FileSystem which is expensive.

Field Summary

Fields

Modifier and Type	Field and Description
static String	ACID_FORMAT
static String	ACID_VERSION_KEY
static int	ORC_ACID_VERSION 2 is the version of Acid released in Hive 3.0.

Constructor Summary

Constructors

Constructor and Description
OrcAcidVersion()

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.fs.Path	getVersionFilePath(org.apache.hadoop.fs.Path deltaOrBase)
static void	setAcidVersionInDataFile(Writer writer) Include current acid version in file footer.
static void	writeVersionFile(org.apache.hadoop.fs.Path deltaOrBaseDir, org.apache.hadoop.fs.FileSystem fs) This creates a version file in deltaOrBaseDir

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ACID_VERSION_KEY

public static final String ACID_VERSION_KEY

See Also:

Constant Field Values

ACID_FORMAT

public static final String ACID_FORMAT

See Also:

Constant Field Values

ORC_ACID_VERSION

public static final int ORC_ACID_VERSION

2 is the version of Acid released in Hive 3.0.

See Also:

Constant Field Values

Constructor Detail

OrcAcidVersion

public OrcAcidVersion()

Method Detail

setAcidVersionInDataFile

public static void setAcidVersionInDataFile(Writer writer)

Include current acid version in file footer.

Parameters:

writer - - file written

writeVersionFile

public static void writeVersionFile(org.apache.hadoop.fs.Path deltaOrBaseDir,
                                    org.apache.hadoop.fs.FileSystem fs)
                             throws IOException

This creates a version file in deltaOrBaseDir

Parameters:

deltaOrBaseDir - - where to create the version file

Throws:

IOException

getVersionFilePath

public static org.apache.hadoop.fs.Path getVersionFilePath(org.apache.hadoop.fs.Path deltaOrBase)