org.deeplearning4j.spark.text.functions

Class TokenizerFunction

java.lang.Object

org.deeplearning4j.spark.text.functions.TokenizerFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<String,List<String>>

public class TokenizerFunction
extends Object
implements org.apache.spark.api.java.function.Function<String,List<String>>

Tokenizer function

Author:

Adam Gibson

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
TokenizerFunction(String tokenizer, String tokenizerPreprocessor, int nGrams)

Method Summary

Modifier and Type	Method and Description
List<String>	call(String v1)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizerFunction

public TokenizerFunction(String tokenizer,
                         String tokenizerPreprocessor,
                         int nGrams)

Method Detail

call

public List<String> call(String v1)
                  throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<String,List<String>>

Throws:

Exception