edu.umd.cloud9.webgraph

Class TrecExtractLinks

java.lang.Object

org.apache.hadoop.conf.Configured

edu.umd.cloud9.util.PowerTool

edu.umd.cloud9.webgraph.TrecExtractLinks

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class TrecExtractLinks
extends PowerTool

Author:

Nima Asadi, Fangyue Wang, metzler

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TrecExtractLinks.Map
static class	TrecExtractLinks.Reduce

Field Summary

Fields

Modifier and Type	Field and Description
static String[]	RequiredParameters

Constructor Summary

Constructors

Constructor and Description
TrecExtractLinks(org.apache.hadoop.conf.Configuration conf)
TrecExtractLinks(org.apache.hadoop.conf.Configuration conf, CollectionConfigurationManager confer)

Method Summary

Methods

Modifier and Type	Method and Description
String[]	getRequiredParameters()
static void	recursivelyAddInputPaths(org.apache.hadoop.mapreduce.Job job, String path)
int	runTool()

Methods inherited from class edu.umd.cloud9.util.PowerTool

run, run

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

RequiredParameters

public static final String[] RequiredParameters

Constructor Detail

TrecExtractLinks

public TrecExtractLinks(org.apache.hadoop.conf.Configuration conf)

TrecExtractLinks

public TrecExtractLinks(org.apache.hadoop.conf.Configuration conf,
                CollectionConfigurationManager confer)

Method Detail

getRequiredParameters

public String[] getRequiredParameters()

Specified by:

getRequiredParameters in class PowerTool

runTool

public int runTool()
            throws Exception

Specified by:

runTool in class PowerTool

Throws:

Exception

recursivelyAddInputPaths

public static void recursivelyAddInputPaths(org.apache.hadoop.mapreduce.Job job,
                            String path)
                                     throws IOException

Throws:

IOException