edu.umd.cloud9.collection.wikipedia

Class WikipediaPageInputFormatOld.WikipediaPageRecordReader

java.lang.Object

edu.umd.cloud9.collection.wikipedia.WikipediaPageInputFormatOld.WikipediaPageRecordReader

All Implemented Interfaces:

org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Enclosing class:

WikipediaPageInputFormatOld

public static class WikipediaPageInputFormatOld.WikipediaPageRecordReader
extends Object
implements org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Hadoop RecordReader for reading Wikipedia pages from the XML dumps.

Constructor Summary

Constructors

Constructor and Description
WikipediaPageInputFormatOld.WikipediaPageRecordReader(org.apache.hadoop.mapred.FileSplit split, org.apache.hadoop.mapred.JobConf conf) Creates a WikipediaPageRecordReader.

Method Summary

Methods

Modifier and Type	Method and Description
void	close() Closes this InputSplit.
org.apache.hadoop.io.LongWritable	createKey() Creates an object for the key.
WikipediaPage	createValue() Creates an object for the value.
long	getPos() Returns the current position in the input.
float	getProgress() Returns progress on how much input has been consumed.
boolean	next(org.apache.hadoop.io.LongWritable key, WikipediaPage value) Reads the next key-value pair.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WikipediaPageInputFormatOld.WikipediaPageRecordReader

public WikipediaPageInputFormatOld.WikipediaPageRecordReader(org.apache.hadoop.mapred.FileSplit split,
                                                     org.apache.hadoop.mapred.JobConf conf)
                                                      throws IOException

Creates a WikipediaPageRecordReader.

Throws:

IOException

Method Detail

next

public boolean next(org.apache.hadoop.io.LongWritable key,
           WikipediaPage value)
             throws IOException

Reads the next key-value pair.

Specified by:

next in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Throws:

IOException

createKey

public org.apache.hadoop.io.LongWritable createKey()

Creates an object for the key.

Specified by:

createKey in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

createValue

public WikipediaPage createValue()

Creates an object for the value.

Specified by:

createValue in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

getPos

public long getPos()
            throws IOException

Returns the current position in the input.

Specified by:

getPos in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Throws:

IOException

close

public void close()
           throws IOException

Closes this InputSplit.

Specified by:

close in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException

Returns progress on how much input has been consumed.

Specified by:

getProgress in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,WikipediaPage>

Throws:

IOException