org.datavec.api.records.reader.impl.misc

Class SVMLightRecordReader

java.lang.Object

org.datavec.api.records.reader.BaseRecordReader

org.datavec.api.records.reader.impl.LineRecordReader

org.datavec.api.records.reader.impl.misc.SVMLightRecordReader

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable, Configurable, RecordReader

public class SVMLightRecordReader
extends LineRecordReader

Adapted from the weka svmlight reader June 2015 - adapted to understand HDFS-style block splits

Author:

Adam Gibson, Josh Patterson

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	NUM_ATTRIBUTES

Fields inherited from class org.datavec.api.records.reader.impl.LineRecordReader

conf, inputSplit, lineIndex, locations, splitIndex

Fields inherited from class org.datavec.api.records.reader.BaseRecordReader

listeners

Fields inherited from interface org.datavec.api.records.reader.RecordReader

APPEND_LABEL, LABELS, NAME_SPACE

Constructor Summary

Constructors

Constructor and Description
SVMLightRecordReader()

Method Summary

Modifier and Type	Method and Description
void	initialize(Configuration conf, InputSplit split) Called once at initialization.
List<Writable>	next() Get the next record
List<Writable>	record(URI uri, DataInputStream dataInputStream) Load the record from the given DataInputStream Unlike RecordReader.next() the internal state of the RecordReader is not modified Implementations of this method should not close the DataInputStream
void	setConf(Configuration conf) Set the configuration to be used by this object.

Methods inherited from class org.datavec.api.records.reader.impl.LineRecordReader

close, closeIfRequired, getConf, getIterator, getLabels, hasNext, initialize, loadFromMetaData, loadFromMetaData, nextRecord, onLocationOpen, reset

Methods inherited from class org.datavec.api.records.reader.BaseRecordReader

getListeners, invokeListeners, setListeners, setListeners

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NUM_ATTRIBUTES

public static final String NUM_ATTRIBUTES

Constructor Detail

SVMLightRecordReader

public SVMLightRecordReader()

Method Detail

next

public List<Writable> next()

Description copied from interface: RecordReader

Get the next record

Specified by:

next in interface RecordReader

Overrides:

next in class LineRecordReader

Returns:

initialize

public void initialize(Configuration conf,
                       InputSplit split)
                throws IOException,
                       InterruptedException

Description copied from interface: RecordReader

Called once at initialization.

Specified by:

initialize in interface RecordReader

Overrides:

initialize in class LineRecordReader

Parameters:

conf - a configuration for initialization

split - the split that defines the range of records to read

Throws:

IOException

InterruptedException

setConf

public void setConf(Configuration conf)

Description copied from interface: Configurable

Set the configuration to be used by this object.

Specified by:

setConf in interface Configurable

Overrides:

setConf in class LineRecordReader

record

public List<Writable> record(URI uri,
                             DataInputStream dataInputStream)
                      throws IOException

Description copied from interface: RecordReader

Load the record from the given DataInputStream Unlike RecordReader.next() the internal state of the RecordReader is not modified Implementations of this method should not close the DataInputStream

Specified by:

record in interface RecordReader

Overrides:

record in class LineRecordReader

Throws:

IOException - if error occurs during reading from the input stream