org.deeplearning4j.datasets.iterator

Class MultiDataSetIteratorSplitter

java.lang.Object

org.deeplearning4j.datasets.iterator.MultiDataSetIteratorSplitter

public class MultiDataSetIteratorSplitter
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected MultiDataSetIterator	backedIterator
protected AtomicLong	counter
protected MultiDataSet	firstTrain
protected long	numArbitrarySets
protected long	numTest
protected long	numTrain
protected double	ratio
protected double[]	ratios
protected AtomicBoolean	resetPending
protected int[]	splits
protected long	totalExamples

Constructor Summary

Constructors

Constructor and Description
MultiDataSetIteratorSplitter(@NonNull MultiDataSetIterator baseIterator, int[] splits)
MultiDataSetIteratorSplitter(@NonNull MultiDataSetIterator baseIterator, long totalBatches, double ratio)
MultiDataSetIteratorSplitter(@NonNull MultiDataSetIterator baseIterator, long totalBatches, double[] ratios)

Method Summary

Modifier and Type	Method and Description
List<MultiDataSetIterator>	getIterators()
MultiDataSetIterator	getTestIterator() Deprecated.
MultiDataSetIterator	getTrainIterator() Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

backedIterator

protected MultiDataSetIterator backedIterator

totalExamples

protected final long totalExamples

ratio

protected final double ratio

numTrain

protected final long numTrain

numTest

protected final long numTest

ratios

protected final double[] ratios

numArbitrarySets

protected final long numArbitrarySets

splits

protected final int[] splits

counter

protected AtomicLong counter

resetPending

protected AtomicBoolean resetPending

firstTrain

protected MultiDataSet firstTrain

Constructor Detail

MultiDataSetIteratorSplitter

public MultiDataSetIteratorSplitter(@NonNull
                                    @NonNull MultiDataSetIterator baseIterator,
                                    long totalBatches,
                                    double ratio)

Parameters:

baseIterator -

totalBatches - - total number of batches in underlying iterator. this value will be used to determine number of test/train batches

ratio - - this value will be used as splitter. should be between in range of 0.0 > X < 1.0. I.e. if value 0.7 is provided, then 70% of total examples will be used for training, and 30% of total examples will be used for testing

MultiDataSetIteratorSplitter

public MultiDataSetIteratorSplitter(@NonNull
                                    @NonNull MultiDataSetIterator baseIterator,
                                    long totalBatches,
                                    double[] ratios)

MultiDataSetIteratorSplitter

public MultiDataSetIteratorSplitter(@NonNull
                                    @NonNull MultiDataSetIterator baseIterator,
                                    int[] splits)

Method Detail

getIterators

public List<MultiDataSetIterator> getIterators()

getTrainIterator

@Deprecated
public MultiDataSetIterator getTrainIterator()

Deprecated.

This method returns train iterator instance

Returns:

getTestIterator

@Deprecated
public MultiDataSetIterator getTestIterator()

Deprecated.

This method returns test iterator instance

Returns: