org.canova.spark.functions

Class RecordReaderFunction

java.lang.Object

org.canova.spark.functions.RecordReaderFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Writable>>

public class RecordReaderFunction
extends Object
implements org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Writable>>

RecordReaderFunction: Given a RecordReader and a file (via Spark PortableDataStream), load and parse the data into a Collection

Author:

Alex Black

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected RecordReader	recordReader

Constructor Summary

Constructors

Constructor and Description
RecordReaderFunction(RecordReader recordReader)

Method Summary

Modifier and Type	Method and Description
Collection<Writable>	call(scala.Tuple2<String,org.apache.spark.input.PortableDataStream> value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

recordReader

protected RecordReader recordReader

Constructor Detail

RecordReaderFunction

public RecordReaderFunction(RecordReader recordReader)

Method Detail

call

public Collection<Writable> call(scala.Tuple2<String,org.apache.spark.input.PortableDataStream> value)
                          throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<scala.Tuple2<String,org.apache.spark.input.PortableDataStream>,Collection<Writable>>

Throws:

Exception