edu.umd.cloud9.collection.trecweb

Class TrecWebDocumentInputFormatOld

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

edu.umd.cloud9.collection.IndexableFileInputFormatOld<org.apache.hadoop.io.LongWritable,TrecWebDocument>

edu.umd.cloud9.collection.trecweb.TrecWebDocumentInputFormatOld

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,TrecWebDocument>

public class TrecWebDocumentInputFormatOld
extends IndexableFileInputFormatOld<org.apache.hadoop.io.LongWritable,TrecWebDocument>

Hadoop InputFormat for processing the TREC collection.

Author:

Jimmy Lin

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TrecWebDocumentInputFormatOld.TrecWebRecordReader Hadoop RecordReader for reading TREC-formatted documents.

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Constructors

Constructor and Description
TrecWebDocumentInputFormatOld()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,TrecWebDocument>	getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter) Returns a RecordReader for this InputFormat.
protected boolean	isSplitable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path filename)

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TrecWebDocumentInputFormatOld

public TrecWebDocumentInputFormatOld()

Method Detail

isSplitable

protected boolean isSplitable(org.apache.hadoop.fs.FileSystem fs,
                  org.apache.hadoop.fs.Path filename)

Overrides:

isSplitable in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,TrecWebDocument>

getRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,TrecWebDocument> getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit,
                                                                                                       org.apache.hadoop.mapred.JobConf conf,
                                                                                                       org.apache.hadoop.mapred.Reporter reporter)
                                                                                                         throws IOException

Returns a RecordReader for this InputFormat.

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,TrecWebDocument>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,TrecWebDocument>

Throws:

IOException