org.apache.hadoop.hive.ql.txn.compactor

Class OrcFileMerger

java.lang.Object

org.apache.hadoop.hive.ql.txn.compactor.OrcFileMerger

public class OrcFileMerger
extends Object

Class to support fast merging of ORC files.

Constructor Summary

Constructors

Constructor and Description
OrcFileMerger(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
boolean	checkCompatibility(List<Reader> readers) Check compatibility between readers.
void	mergeFiles(List<Reader> readers, org.apache.hadoop.fs.Path outPath) Merge orc files into a single file

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OrcFileMerger

public OrcFileMerger(org.apache.hadoop.conf.Configuration conf)

Method Detail

mergeFiles

public void mergeFiles(List<Reader> readers,
                       org.apache.hadoop.fs.Path outPath)
                throws IOException

Merge orc files into a single file

Parameters:

readers - list of orc file paths to be merged

outPath - the path of output orc file

Throws:

IOException - error happened during file operations

checkCompatibility

public boolean checkCompatibility(List<Reader> readers)

Check compatibility between readers.

Parameters:

readers - list of readers

Returns:

true, if the readers are compatible