org.deeplearning4j.datasets.iterator.loader

Class DataSetLoaderIterator

java.lang.Object

org.deeplearning4j.datasets.iterator.loader.DataSetLoaderIterator

All Implemented Interfaces:

Serializable, Iterator<DataSet>, DataSetIterator

public class DataSetLoaderIterator
extends Object
implements DataSetIterator

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected Iterator<String>	iter
protected org.nd4j.common.loader.Loader<DataSet>	loader
protected int[]	order
protected List<String>	paths
protected int	position
protected DataSetPreProcessor	preProcessor
protected Random	rng
protected org.nd4j.common.loader.SourceFactory	sourceFactory

Constructor Summary

Constructors

Constructor and Description
DataSetLoaderIterator(Collection<String> paths, org.nd4j.common.loader.Loader<DataSet> loader, org.nd4j.common.loader.SourceFactory sourceFactory) Iterate of the specified collection of strings without randomization
DataSetLoaderIterator(Collection<String> paths, Random rng, org.nd4j.common.loader.Loader<DataSet> loader, org.nd4j.common.loader.SourceFactory sourceFactory) Iterate of the specified collection of strings with optional randomization
DataSetLoaderIterator(Iterator<String> paths, org.nd4j.common.loader.Loader<DataSet> loader, org.nd4j.common.loader.SourceFactory sourceFactory) NOTE: When using this constructor (with Iterator<String>) the DataSetIterator cannot be reset.

Method Summary

Modifier and Type	Method and Description
boolean	asyncSupported()
int	batch()
List<String>	getLabels()
boolean	hasNext()
int	inputColumns()
DataSet	next()
DataSet	next(int i)
void	remove()
void	reset()
boolean	resetSupported()
int	totalOutcomes()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

getPreProcessor, setPreProcessor

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

paths

protected final List<String> paths

iter

protected final Iterator<String> iter

sourceFactory

protected final org.nd4j.common.loader.SourceFactory sourceFactory

loader

protected final org.nd4j.common.loader.Loader<DataSet> loader

rng

protected final Random rng

order

protected final int[] order

position

protected int position

preProcessor

protected DataSetPreProcessor preProcessor

Constructor Detail

DataSetLoaderIterator

public DataSetLoaderIterator(Iterator<String> paths,
                             org.nd4j.common.loader.Loader<DataSet> loader,
                             org.nd4j.common.loader.SourceFactory sourceFactory)

NOTE: When using this constructor (with Iterator<String>) the DataSetIterator cannot be reset. Use the other construtor that takes Collection<String>

Parameters:

paths - Paths to iterate over

loader - Loader to use when loading DataSets

sourceFactory - The factory to use to convert the paths into streams via Source

DataSetLoaderIterator

public DataSetLoaderIterator(Collection<String> paths,
                             org.nd4j.common.loader.Loader<DataSet> loader,
                             org.nd4j.common.loader.SourceFactory sourceFactory)

Iterate of the specified collection of strings without randomization

Parameters:

paths - Paths to iterate over

loader - Loader to use when loading DataSets

sourceFactory - The factory to use to convert the paths into streams via Source

DataSetLoaderIterator

public DataSetLoaderIterator(Collection<String> paths,
                             Random rng,
                             org.nd4j.common.loader.Loader<DataSet> loader,
                             org.nd4j.common.loader.SourceFactory sourceFactory)

Iterate of the specified collection of strings with optional randomization

Parameters:

paths - Paths to iterate over

rng - Optional random instance to use for shuffling of order. If null, no shuffling will be used.

loader - Loader to use when loading DataSets

sourceFactory - The factory to use to convert the paths into streams via Source

Method Detail

next

public DataSet next(int i)

Specified by:

next in interface DataSetIterator

inputColumns

public int inputColumns()

Specified by:

inputColumns in interface DataSetIterator

totalOutcomes

public int totalOutcomes()

Specified by:

totalOutcomes in interface DataSetIterator

resetSupported

public boolean resetSupported()

Specified by:

resetSupported in interface DataSetIterator

asyncSupported

public boolean asyncSupported()

Specified by:

asyncSupported in interface DataSetIterator

reset

public void reset()

Specified by:

reset in interface DataSetIterator

batch

public int batch()

Specified by:

batch in interface DataSetIterator

getLabels

public List<String> getLabels()

Specified by:

getLabels in interface DataSetIterator

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<DataSet>

next

public DataSet next()

Specified by:

next in interface Iterator<DataSet>

remove

public void remove()

Specified by:

remove in interface Iterator<DataSet>