org.canova.spark.functions

Class SequenceRecordReaderFunction

java.lang.Object

org.canova.spark.functions.SequenceRecordReaderFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Collection<Writable>>>

public class SequenceRecordReaderFunction
extends Object
implements org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Collection<Writable>>>

RecordReaderFunction: Given a SequenceRecordReader and a file (via Spark PortableDataStream), load and parse the sequence data into a Collection>

Author:

Alex Black

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected SequenceRecordReader	sequenceRecordReader

Constructor Summary

Constructors

Constructor and Description
SequenceRecordReaderFunction(SequenceRecordReader sequenceRecordReader)

Method Summary

Modifier and Type	Method and Description
Collection<Collection<Writable>>	call(scala.Tuple2<String,org.apache.spark.input.PortableDataStream> value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sequenceRecordReader

protected SequenceRecordReader sequenceRecordReader

Constructor Detail

SequenceRecordReaderFunction

public SequenceRecordReaderFunction(SequenceRecordReader sequenceRecordReader)

Method Detail

call

public Collection<Collection<Writable>> call(scala.Tuple2<String,org.apache.spark.input.PortableDataStream> value)
                                      throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Collection<Writable>>>

Throws:

Exception