intoxicant.analytics.corenlp

Class StopwordAnnotator

java.lang.Object

intoxicant.analytics.corenlp.StopwordAnnotator

All Implemented Interfaces:

edu.stanford.nlp.ling.CoreAnnotation<edu.stanford.nlp.util.Pair<Boolean,Boolean>>, edu.stanford.nlp.pipeline.Annotator, edu.stanford.nlp.util.TypesafeMap.Key<edu.stanford.nlp.util.Pair<Boolean,Boolean>>

public class StopwordAnnotator
extends Object
implements edu.stanford.nlp.pipeline.Annotator, edu.stanford.nlp.ling.CoreAnnotation<edu.stanford.nlp.util.Pair<Boolean,Boolean>>

CoreNlp Annotator that checks if in coming token is a stopword

Author:

John Conwell, Paul Landes

Field Summary

Fields

Modifier and Type	Field and Description
static String	ANNOTATOR_CLASS stopword annotator class name used in annotators property
static String	IGNORE_STOPWORD_CASE Property key to specify if stopword list is case insensitive
static String	STOPWORDS_LIST Property key to specify the comma delimited list of custom stopwords

Fields inherited from interface edu.stanford.nlp.pipeline.Annotator

DEFAULT_REQUIREMENTS, STANFORD_CLEAN_XML, STANFORD_COLUMN_DATA_CLASSIFIER, STANFORD_COREF, STANFORD_DEPENDENCIES, STANFORD_DETERMINISTIC_COREF, STANFORD_ENTITY_MENTIONS, STANFORD_GENDER, STANFORD_KBP, STANFORD_LEMMA, STANFORD_LINK, STANFORD_MENTION, STANFORD_NATLOG, STANFORD_NER, STANFORD_OPENIE, STANFORD_PARSE, STANFORD_POS, STANFORD_QUOTE, STANFORD_REGEXNER, STANFORD_RELATION, STANFORD_SENTIMENT, STANFORD_SSPLIT, STANFORD_TOKENIZE, STANFORD_TRUECASE, STANFORD_UD_FEATURES

Constructor Summary

Constructors

Constructor and Description
StopwordAnnotator()
StopwordAnnotator(Properties props)
StopwordAnnotator(String notUsed, Properties props)

Method Summary

Modifier and Type	Method and Description
void	annotate(edu.stanford.nlp.pipeline.Annotation annotation)
static org.apache.lucene.analysis.util.CharArraySet	getStopWordList(org.apache.lucene.util.Version luceneVersion, String stopwordList, boolean ignoreCase)
Class<edu.stanford.nlp.util.Pair<Boolean,Boolean>>	getType()
Set<Class<? extends edu.stanford.nlp.ling.CoreAnnotation>>	requirementsSatisfied()
Set<Class<? extends edu.stanford.nlp.ling.CoreAnnotation>>	requires()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ANNOTATOR_CLASS

public static final String ANNOTATOR_CLASS

stopword annotator class name used in annotators property

See Also:

Constant Field Values

STOPWORDS_LIST

public static final String STOPWORDS_LIST

Property key to specify the comma delimited list of custom stopwords

See Also:

Constant Field Values

IGNORE_STOPWORD_CASE

public static final String IGNORE_STOPWORD_CASE

Property key to specify if stopword list is case insensitive

See Also:

Constant Field Values

Constructor Detail

StopwordAnnotator

public StopwordAnnotator()

StopwordAnnotator

public StopwordAnnotator(String notUsed,
                         Properties props)

StopwordAnnotator

public StopwordAnnotator(Properties props)

Method Detail

annotate

public void annotate(edu.stanford.nlp.pipeline.Annotation annotation)

Specified by:

annotate in interface edu.stanford.nlp.pipeline.Annotator

requirementsSatisfied

public Set<Class<? extends edu.stanford.nlp.ling.CoreAnnotation>> requirementsSatisfied()

Specified by:

requirementsSatisfied in interface edu.stanford.nlp.pipeline.Annotator

requires

public Set<Class<? extends edu.stanford.nlp.ling.CoreAnnotation>> requires()

Specified by:

requires in interface edu.stanford.nlp.pipeline.Annotator

getType

public Class<edu.stanford.nlp.util.Pair<Boolean,Boolean>> getType()

Specified by:

getType in interface edu.stanford.nlp.ling.CoreAnnotation<edu.stanford.nlp.util.Pair<Boolean,Boolean>>

getStopWordList

public static org.apache.lucene.analysis.util.CharArraySet getStopWordList(org.apache.lucene.util.Version luceneVersion,
                                                                           String stopwordList,
                                                                           boolean ignoreCase)