edu.utah.bmi.nlp

Class SimpleParser

java.lang.Object

edu.utah.bmi.nlp.SimpleParser

public class SimpleParser
extends Object

Author:

Jianlin Shi

Field Summary

Fields

Modifier and Type	Field and Description
protected static int	digit
protected static int	dot
protected static int	letter
protected static int	punctuation
protected static int	returnc

Constructor Summary

Constructors

Constructor and Description
SimpleParser()

Method Summary

Modifier and Type	Method and Description
static ArrayList<Span>	tokenize2Spans(String text, boolean includePunctuation) Tokenize to an ArrayList of Spans, regardless of sentences or paragraphs

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

punctuation

protected static final int punctuation

See Also:

Constant Field Values

letter

protected static final int letter

See Also:

Constant Field Values

digit

protected static final int digit

See Also:

Constant Field Values

dot

protected static final int dot

See Also:

Constant Field Values

returnc

protected static final int returnc

See Also:

Constant Field Values

Constructor Detail

SimpleParser

public SimpleParser()

Method Detail

tokenize2Spans

public static ArrayList<Span> tokenize2Spans(String text,
                                             boolean includePunctuation)

Tokenize to an ArrayList of Spans, regardless of sentences or paragraphs

Parameters:

text - The input text string for tokenization

includePunctuation - Whether include punctuations when tokenizing

Returns:

An ArrayList of tokens in Span object format