edu.umd.hooka

Class AlignmentWordPreprocessor

java.lang.Object

edu.umd.hooka.AlignmentWordPreprocessor

public abstract class AlignmentWordPreprocessor
extends Object

This class contains tokenizers for several languages. The method to tokenize a sentence is preprocessWordsImpl. The input is an array of Strings, generated by splitting the input sentence by space characters.

Author:

ferhanture

Constructor Summary

Constructors

Constructor and Description
AlignmentWordPreprocessor()

Method Summary

Methods

Modifier and Type	Method and Description
static AlignmentWordPreprocessor	CreatePreprocessor(LanguagePair lp, Language l, org.apache.hadoop.conf.Configuration conf)
String[]	preprocessWordsForAlignment(String[] arg)
protected abstract String[]	preprocessWordsImpl(String[] arg)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AlignmentWordPreprocessor

public AlignmentWordPreprocessor()

Method Detail

preprocessWordsForAlignment

public final String[] preprocessWordsForAlignment(String[] arg)

preprocessWordsImpl

protected abstract String[] preprocessWordsImpl(String[] arg)

CreatePreprocessor

public static AlignmentWordPreprocessor CreatePreprocessor(LanguagePair lp,
                                           Language l,
                                           org.apache.hadoop.conf.Configuration conf)