org.deeplearning4j.spark.models.embeddings.glove.cooccurrences

Class CoOccurrenceCalculator

java.lang.Object

org.deeplearning4j.spark.models.embeddings.glove.cooccurrences.CoOccurrenceCalculator

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<Pair<List<String>,AtomicLong>,CounterMap<String,String>>

public class CoOccurrenceCalculator
extends Object
implements org.apache.spark.api.java.function.Function<Pair<List<String>,AtomicLong>,CounterMap<String,String>>

Calculate co occurrences based on tokens

Author:

Adam Gibson

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CoOccurrenceCalculator(boolean symmetric, org.apache.spark.broadcast.Broadcast<VocabCache<VocabWord>> vocab, int windowSize)

Method Summary

Modifier and Type	Method and Description
CounterMap<String,String>	call(Pair<List<String>,AtomicLong> pair)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CoOccurrenceCalculator

public CoOccurrenceCalculator(boolean symmetric,
                              org.apache.spark.broadcast.Broadcast<VocabCache<VocabWord>> vocab,
                              int windowSize)

Method Detail

call

public CounterMap<String,String> call(Pair<List<String>,AtomicLong> pair)
                               throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<Pair<List<String>,AtomicLong>,CounterMap<String,String>>

Throws:

Exception