org.apache.hadoop.hive.ql.io

Class HiveSequenceFileInputFormat<K extends org.apache.hadoop.io.LongWritable,V extends BytesRefArrayWritable>

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFormat<K,V>

org.apache.hadoop.hive.ql.io.HiveSequenceFileInputFormat<K,V>

Type Parameters:

K -

V -

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<K,V>

public class HiveSequenceFileInputFormat<K extends org.apache.hadoop.io.LongWritable,V extends BytesRefArrayWritable>
extends org.apache.hadoop.mapred.SequenceFileInputFormat<K,V>

HiveSequenceFileInputFormat. This input format is used by Fetch Operator. This input format does list status on list of files (kept in listsToFetch) instead of doing list on whole directory as done by previously used SequenceFileFormat. To use this FileFormat make sure to provide the list of files

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
HiveSequenceFileInputFormat()

Method Summary

Modifier and Type	Method and Description
protected org.apache.hadoop.fs.FileStatus[]	listStatus(org.apache.hadoop.mapred.JobConf job)
void	setFiles(Set<org.apache.hadoop.fs.FileStatus> fileStatuses)

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

getRecordReader

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveSequenceFileInputFormat

public HiveSequenceFileInputFormat()

Method Detail

setFiles

public void setFiles(Set<org.apache.hadoop.fs.FileStatus> fileStatuses)

listStatus

protected org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.mapred.JobConf job)
                                                throws IOException

Overrides:

listStatus in class org.apache.hadoop.mapred.SequenceFileInputFormat<K extends org.apache.hadoop.io.LongWritable,V extends BytesRefArrayWritable>

Throws:

IOException