edu.umd.hooka.alignment

Class HadoopAlign

java.lang.Object

edu.umd.hooka.alignment.HadoopAlign

public class HadoopAlign
extends Object

General EM training framework for word alignment models.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	HadoopAlign.AEListener
static class	HadoopAlign.AlignMapper
static class	HadoopAlign.AlignmentBase
static class	HadoopAlign.AlignmentEvalEnum
static class	HadoopAlign.EMapper
static class	HadoopAlign.EMReducer
static class	HadoopAlign.FileReaderZip Basic implementation: assume keys are IntWritable, values are Phrase Better implementation: use Java Generics to templatize, ie.
static class	HadoopAlign.ModelMergeMapper

Constructor Summary

Constructors

Constructor and Description
HadoopAlign()

Method Summary

Methods

Modifier and Type	Method and Description
static void	doAlignment(int mapTasks, int reduceTasks, HadoopAlignConfig hac)
static ATable	loadATable(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration job)
static Vocab	loadVocab(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration job)
static Vocab	loadVocab(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fileSys)
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopAlign

public HadoopAlign()

Method Detail

loadATable

public static ATable loadATable(org.apache.hadoop.fs.Path path,
                org.apache.hadoop.conf.Configuration job)
                         throws IOException

Throws:

IOException

loadVocab

public static Vocab loadVocab(org.apache.hadoop.fs.Path path,
              org.apache.hadoop.conf.Configuration job)
                       throws IOException

Throws:

IOException

loadVocab

public static Vocab loadVocab(org.apache.hadoop.fs.Path path,
              org.apache.hadoop.fs.FileSystem fileSys)
                       throws IOException

Throws:

IOException

doAlignment

public static void doAlignment(int mapTasks,
               int reduceTasks,
               HadoopAlignConfig hac)
                        throws IOException

Throws:

IOException

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException