org.deeplearning4j.datasets.iterator

Class DataSetIteratorSplitter

java.lang.Object

org.deeplearning4j.datasets.iterator.DataSetIteratorSplitter

public class DataSetIteratorSplitter
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected DataSetIterator	backedIterator
protected AtomicLong	counter
protected DataSet	firstTrain
protected long	numArbitrarySets
protected long	numTest
protected long	numTrain
protected int	partNumber
protected double	ratio
protected double[]	ratios
protected AtomicBoolean	resetPending
protected int[]	splits
protected long	totalExamples

Constructor Summary

Constructors

Constructor and Description
DataSetIteratorSplitter(@NonNull DataSetIterator baseIterator, int[] splits)
DataSetIteratorSplitter(@NonNull DataSetIterator baseIterator, long totalBatches, double ratio) The only constructor
DataSetIteratorSplitter(@NonNull DataSetIterator baseIterator, long totalBatches, double[] ratios)

Method Summary

Modifier and Type	Method and Description
List<DataSetIterator>	getIterators()
DataSetIterator	getTestIterator() Deprecated.
DataSetIterator	getTrainIterator() Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

backedIterator

protected DataSetIterator backedIterator

totalExamples

protected final long totalExamples

ratio

protected final double ratio

ratios

protected final double[] ratios

numTrain

protected final long numTrain

numTest

protected final long numTest

numArbitrarySets

protected final long numArbitrarySets

splits

protected final int[] splits

counter

protected AtomicLong counter

resetPending

protected AtomicBoolean resetPending

firstTrain

protected DataSet firstTrain

partNumber

protected int partNumber

Constructor Detail

DataSetIteratorSplitter

public DataSetIteratorSplitter(@NonNull
                               @NonNull DataSetIterator baseIterator,
                               long totalBatches,
                               double ratio)

The only constructor

Parameters:

baseIterator - - iterator to be wrapped and split

totalBatches - - total batches in baseIterator

ratio - - train/test split ratio

DataSetIteratorSplitter

public DataSetIteratorSplitter(@NonNull
                               @NonNull DataSetIterator baseIterator,
                               long totalBatches,
                               double[] ratios)

DataSetIteratorSplitter

public DataSetIteratorSplitter(@NonNull
                               @NonNull DataSetIterator baseIterator,
                               int[] splits)

Method Detail

getIterators

public List<DataSetIterator> getIterators()

getTrainIterator

@Deprecated
public DataSetIterator getTrainIterator()

Deprecated.

This method returns train iterator instance

Returns:

getTestIterator

@Deprecated
public DataSetIterator getTestIterator()

Deprecated.

This method returns test iterator instance

Returns: