edu.umd.cloud9.collection

Class XMLInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

org.apache.hadoop.mapreduce.lib.input.TextInputFormat

edu.umd.cloud9.collection.XMLInputFormat

public class XMLInputFormat
extends org.apache.hadoop.mapreduce.lib.input.TextInputFormat

A simple InputFormat for XML documents (org.apache.hadoop.mapreduce API). The class recognizes begin-of-document and end-of-document tags only: everything between those delimiting tags is returned in an uninterpreted Text object.

Author:

Jimmy Lin

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	XMLInputFormat.XMLRecordReader Simple RecordReader for XML documents (org.apache.hadoop.mapreduce API).

Field Summary

Fields

Modifier and Type	Field and Description
static String	END_TAG_KEY
static String	START_TAG_KEY

Constructor Summary

Constructors

Constructor and Description
XMLInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create a record reader for a given split.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.TextInputFormat

isSplitable

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

START_TAG_KEY

public static final String START_TAG_KEY

See Also:

Constant Field Values

END_TAG_KEY

public static final String END_TAG_KEY

See Also:

Constant Field Values

Constructor Detail

XMLInputFormat

public XMLInputFormat()

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                       org.apache.hadoop.mapreduce.TaskAttemptContext context)

Create a record reader for a given split. The framework will call RecordReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Overrides:

createRecordReader in class org.apache.hadoop.mapreduce.lib.input.TextInputFormat

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

IOException

InterruptedException