edu.umd.cloud9.collection.wikipedia

Class WikipediaPageInputFormatOld

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

edu.umd.cloud9.collection.IndexableFileInputFormatOld<org.apache.hadoop.io.LongWritable,WikipediaPage>

edu.umd.cloud9.collection.wikipedia.WikipediaPageInputFormatOld

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,WikipediaPage>

public class WikipediaPageInputFormatOld
extends IndexableFileInputFormatOld<org.apache.hadoop.io.LongWritable,WikipediaPage>

Hadoop InputFormat for processing Wikipedia pages from the XML dumps.

Author:

Jimmy Lin, Peter Exner

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WikipediaPageInputFormatOld.WikipediaPageRecordReader Hadoop RecordReader for reading Wikipedia pages from the XML dumps.

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Constructors

Constructor and Description
WikipediaPageInputFormatOld()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>	getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter) Returns a RecordReader for this InputFormat.

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WikipediaPageInputFormatOld

public WikipediaPageInputFormatOld()

Method Detail

getRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage> getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit,
                                                                                                     org.apache.hadoop.mapred.JobConf conf,
                                                                                                     org.apache.hadoop.mapred.Reporter reporter)
                                                                                                       throws IOException

Returns a RecordReader for this InputFormat.

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,WikipediaPage>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,WikipediaPage>

Throws:

IOException