org.datavec.cli.records.reader

Class LineRecordReader

java.lang.Object

org.datavec.api.records.reader.BaseRecordReader

org.datavec.api.records.reader.impl.FileRecordReader

org.datavec.cli.records.reader.LineRecordReader

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable, Configurable, RecordReader

public class LineRecordReader
extends FileRecordReader

Hardcoded for serial only access (for now)

Author:

josh

See Also:

Serialized Form

Field Summary

Fields inherited from class org.datavec.api.records.reader.impl.FileRecordReader

appendLabel, currentFile, inputSplit, iter, labels

Fields inherited from class org.datavec.api.records.reader.BaseRecordReader

listeners

Fields inherited from interface org.datavec.api.records.reader.RecordReader

APPEND_LABEL, LABELS, NAME_SPACE

Constructor Summary

Constructors

Constructor and Description
LineRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close()
Configuration	getConf()
String	getCurrentDirectoryLabelPath()
boolean	hasNext()
void	initialize(Configuration conf, InputSplit split) Need to look at the lines in a set of files in directories
void	initialize(InputSplit split)
Collection<Writable>	next() Major difference here: we ALWAYS append label as string - we've also kicked the responsibility of indexing labels UP a level to the vectorization engine for text NEED to look at the file iterator (iter)
void	setConf(Configuration conf)

Methods inherited from class org.datavec.api.records.reader.impl.FileRecordReader

doInitialize, getCurrentLabel, getLabels, record, reset, setLabels

Methods inherited from class org.datavec.api.records.reader.BaseRecordReader

getListeners, invokeListeners, setListeners, setListeners

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineRecordReader

public LineRecordReader()

Method Detail

initialize

public void initialize(InputSplit split)
                throws IOException,
                       InterruptedException

Specified by:

initialize in interface RecordReader

Overrides:

initialize in class FileRecordReader

Throws:

IOException

InterruptedException

initialize

public void initialize(Configuration conf,
                       InputSplit split)
                throws IOException,
                       InterruptedException

Need to look at the lines in a set of files in directories

Specified by:

initialize in interface RecordReader

Overrides:

initialize in class FileRecordReader

Throws:

IOException

InterruptedException

next

public Collection<Writable> next()

Major difference here: we ALWAYS append label as string - we've also kicked the responsibility of indexing labels UP a level to the vectorization engine for text NEED to look at the file iterator (iter)

Specified by:

next in interface RecordReader

Overrides:

next in class FileRecordReader

hasNext

public boolean hasNext()

Specified by:

hasNext in interface RecordReader

Overrides:

hasNext in class FileRecordReader

getCurrentDirectoryLabelPath

public String getCurrentDirectoryLabelPath()

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class FileRecordReader

Throws:

IOException

setConf

public void setConf(Configuration conf)

Specified by:

setConf in interface Configurable

Overrides:

setConf in class FileRecordReader

getConf

public Configuration getConf()

Specified by:

getConf in interface Configurable

Overrides:

getConf in class FileRecordReader