edu.umd.cloud9.collection.wikipedia

Class WikipediaDocnoMappingBuilder

java.lang.Object

org.apache.hadoop.conf.Configured

edu.umd.cloud9.collection.wikipedia.WikipediaDocnoMappingBuilder

All Implemented Interfaces:

DocnoMapping.Builder, org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class WikipediaDocnoMappingBuilder
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool, DocnoMapping.Builder

Tool for building the mapping between Wikipedia internal ids (docids) and sequentially-numbered ints (docnos).

Author:

Jimmy Lin, Peter Exner

Field Summary

Fields

Modifier and Type	Field and Description
static String	INPUT_OPTION
static String	KEEP_ALL_OPTION
static String	LANGUAGE_OPTION
static String	OUTPUT_FILE_OPTION

Constructor Summary

Constructors

Constructor and Description
WikipediaDocnoMappingBuilder()

Method Summary

Methods

Modifier and Type	Method and Description
int	build(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dest, org.apache.hadoop.conf.Configuration conf)
static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

INPUT_OPTION

public static final String INPUT_OPTION

See Also:

Constant Field Values

OUTPUT_FILE_OPTION

public static final String OUTPUT_FILE_OPTION

See Also:

Constant Field Values

KEEP_ALL_OPTION

public static final String KEEP_ALL_OPTION

See Also:

Constant Field Values

LANGUAGE_OPTION

public static final String LANGUAGE_OPTION

See Also:

Constant Field Values

Constructor Detail

WikipediaDocnoMappingBuilder

public WikipediaDocnoMappingBuilder()

Method Detail

build

public int build(org.apache.hadoop.fs.Path src,
        org.apache.hadoop.fs.Path dest,
        org.apache.hadoop.conf.Configuration conf)
          throws IOException

Specified by:

build in interface DocnoMapping.Builder

Throws:

IOException

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception