Package opennlp.tools.util.featuregen
Class WindowFeatureGenerator
java.lang.Object
opennlp.tools.util.featuregen.WindowFeatureGenerator
- All Implemented Interfaces:
AdaptiveFeatureGenerator
Generates previous and next features for a given
AdaptiveFeatureGenerator.
The window size can be specified.
Features:
Current token is always included unchanged
Previous tokens are prefixed with p distance
Next tokens are prefix with n distance-
Field Summary
Fields -
Constructor Summary
ConstructorsConstructorDescriptionWindowFeatureGenerator(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.WindowFeatureGenerator(AdaptiveFeatureGenerator generator) Initializes the current instance.WindowFeatureGenerator(AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.WindowFeatureGenerator(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize) Initializes the current instance with the given parameters. -
Method Summary
Modifier and TypeMethodDescriptionvoidInforms the feature generator that the context of the adaptive data (typically a document) is no longer valid.voidcreateFeatures(List<String> features, String[] tokens, int index, String[] preds) Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.toString()voidupdateAdaptiveData(String[] tokens, String[] outcomes) Informs the feature generator that the specified tokens have been classified with the corresponding set of specified outcomes.
-
Field Details
-
PREV_PREFIX
- See Also:
-
NEXT_PREFIX
- See Also:
-
-
Constructor Details
-
WindowFeatureGenerator
public WindowFeatureGenerator(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize) Initializes the current instance with the given parameters.- Parameters:
generator- Feature generator to apply to the window.prevWindowSize- Size of the window to the left of the current token.nextWindowSize- Size of the window to the right of the current token.
-
WindowFeatureGenerator
public WindowFeatureGenerator(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.- Parameters:
prevWindowSize-nextWindowSize-generators-
-
WindowFeatureGenerator
Initializes the current instance. The previous and next window size is 5.- Parameters:
generator- feature generator
-
WindowFeatureGenerator
Initializes the current instance with the given parameters.- Parameters:
generators- array of feature generators
-
-
Method Details
-
createFeatures
Description copied from interface:AdaptiveFeatureGeneratorAdds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.- Specified by:
createFeaturesin interfaceAdaptiveFeatureGenerator- Parameters:
features- The list of features to be added to.tokens- The tokens of the sentence or other text unit being processed.index- The index of the token which is currently being processed.preds- The outcomes for the tokens prior to the specified index.
-
updateAdaptiveData
Description copied from interface:AdaptiveFeatureGeneratorInforms the feature generator that the specified tokens have been classified with the corresponding set of specified outcomes.- Specified by:
updateAdaptiveDatain interfaceAdaptiveFeatureGenerator- Parameters:
tokens- The tokens of the sentence or other text unit which has been processed.outcomes- The outcomes associated with the specified tokens.
-
clearAdaptiveData
public void clearAdaptiveData()Description copied from interface:AdaptiveFeatureGeneratorInforms the feature generator that the context of the adaptive data (typically a document) is no longer valid.- Specified by:
clearAdaptiveDatain interfaceAdaptiveFeatureGenerator
-
toString
-