Uses of Interface
org.nd4j.linalg.dataset.api.MultiDataSet
-
-
Uses of MultiDataSet in org.nd4j.autodiff.listeners
Methods in org.nd4j.autodiff.listeners with parameters of type MultiDataSet Modifier and Type Method Description voidBaseEvaluationListener. activationAvailable(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, String varName, INDArray activation)voidBaseListener. activationAvailable(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, String varName, INDArray activation)voidListener. activationAvailable(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, String varName, INDArray activation)Called when any activation becomes available.voidBaseEvaluationListener. activationAvailableEvaluations(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, String varName, INDArray activation)voidBaseListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss)voidListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss)Called at the end of every iteration, after all operations (including updating parameters) has been completedvoidBaseListener. iterationStart(SameDiff sd, At at, MultiDataSet data, long etlMs)voidListener. iterationStart(SameDiff sd, At at, MultiDataSet data, long etlTimeMs)Called at the start of every iteration (minibatch), before any operations have been executedvoidBaseListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs)voidListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs)Called at the end of each operation execution -
Uses of MultiDataSet in org.nd4j.autodiff.listeners.checkpoint
Methods in org.nd4j.autodiff.listeners.checkpoint with parameters of type MultiDataSet Modifier and Type Method Description voidCheckpointListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss) -
Uses of MultiDataSet in org.nd4j.autodiff.listeners.debugging
Methods in org.nd4j.autodiff.listeners.debugging with parameters of type MultiDataSet Modifier and Type Method Description voidArraySavingListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs)voidControlflowListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs)voidOpBenchmarkListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs) -
Uses of MultiDataSet in org.nd4j.autodiff.listeners.impl
Methods in org.nd4j.autodiff.listeners.impl with parameters of type MultiDataSet Modifier and Type Method Description voidScoreListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss)voidUIListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss)voidScoreListener. iterationStart(SameDiff sd, At at, MultiDataSet data, long etlMs)voidUIListener. iterationStart(SameDiff sd, At at, MultiDataSet data, long etlMs)voidUIListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs) -
Uses of MultiDataSet in org.nd4j.autodiff.listeners.profiler
Methods in org.nd4j.autodiff.listeners.profiler with parameters of type MultiDataSet Modifier and Type Method Description voidProfilingListener. iterationDone(SameDiff sd, At at, MultiDataSet dataSet, Loss loss)voidProfilingListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs) -
Uses of MultiDataSet in org.nd4j.autodiff.samediff
Methods in org.nd4j.autodiff.samediff with parameters of type MultiDataSet Modifier and Type Method Description protected ExecutionResultSameDiff. directExecHelper(Map<String,INDArray> placeholders, Map<String,SDValue> otherPlaceHolders, At at, MultiDataSet batch, Collection<String> requiredActivations, List<Listener> activeListeners, String... outputs)Do inference for the given variables for a single batch, with training informationprotected ExecutionResultSameDiff. directExecHelper(Map<String,INDArray> placeholders, At at, MultiDataSet batch, Collection<String> requiredActivations, List<Listener> activeListeners, String... outputs)Do inference for the given variables for a single batch, with training informationHistorySameDiff. fit(@NonNull MultiDataSet dataSet, @NonNull Listener... listeners)Fit the SameDiff instance based on a single MultiDataSet (i.e., a single minibatch for one iteration).
Note that aTrainingConfigmust be set viaSameDiff.setTrainingConfig(TrainingConfig)before training can be performed.Map<String,INDArray>SameDiff. output(@NonNull MultiDataSet dataSet, @NonNull String... outputs)Do a single batch inference on a network.
For example, if the variable to infer was called "softmax" you would use: -
Uses of MultiDataSet in org.nd4j.autodiff.samediff.config
Methods in org.nd4j.autodiff.samediff.config with parameters of type MultiDataSet Modifier and Type Method Description OutputConfigOutputConfig. data(@NonNull MultiDataSet data)Set the data to use as input. -
Uses of MultiDataSet in org.nd4j.autodiff.samediff.internal
Methods in org.nd4j.autodiff.samediff.internal with parameters of type MultiDataSet Modifier and Type Method Description abstract ExecutionResultAbstractSession. getOutputs(O op, FrameIter outputFrameIter, Set<AbstractSession.VarId> inputs, Set<AbstractSession.VarId> allIterInputs, Set<String> constAndPhInputs, List<Listener> listeners, At at, MultiDataSet batch, Set<String> allReqVariables, Map<String,SDValue> otherPlaceHolders)Execute the op - calculate INDArrays, or shape info, etcExecutionResultInferenceSession. getOutputs(Pair<SameDiffOp,OpContext> opPair, FrameIter outputFrameIter, Set<AbstractSession.VarId> opInputs, Set<AbstractSession.VarId> allIterInputs, Set<String> constAndPhInputs, List<Listener> listeners, At at, MultiDataSet batch, Set<String> allReqVariables, Map<String,SDValue> otherPlaceHolders)ExecutionResultTrainingSession. getOutputs(Pair<SameDiffOp,OpContext> opPair, FrameIter outputFrameIter, Set<AbstractSession.VarId> opInputs, Set<AbstractSession.VarId> allIterInputs, Set<String> constAndPhInputs, List<Listener> listeners, At at, MultiDataSet batch, Set<String> allReqVariables, Map<String,SDValue> otherPlaceHolders)ExecutionResultAbstractSession. output(@NonNull List<String> variables, Map<String,T> placeholderValues, Map<String,SDValue> otherPlaceHolderValues, MultiDataSet batch, Collection<String> requiredActivations, List<Listener> listeners, At at)Get the output of the session - i.e., perform inference/forward pass and return the outputs for the specified variablesMap<String,T>AbstractSession. output(@NonNull List<String> variables, Map<String,T> placeholderValues, MultiDataSet batch, Collection<String> requiredActivations, List<Listener> listeners, At at)Get the output of the session - i.e., perform inference/forward pass and return the outputs for the specified variablesLossTrainingSession. trainingIteration(TrainingConfig config, Map<String,INDArray> placeholders, Set<String> paramsToTrain, Map<String,GradientUpdater> updaters, MultiDataSet batch, List<String> lossVariables, List<Listener> listeners, At at)Perform one iteration of training - i.e., do forward and backward passes, and update the parameters -
Uses of MultiDataSet in org.nd4j.autodiff.validation
Methods in org.nd4j.autodiff.validation with parameters of type MultiDataSet Modifier and Type Method Description voidActivationGradientCheckListener. opExecution(SameDiff sd, At at, MultiDataSet batch, SameDiffOp op, OpContext opContext, INDArray[] outputs) -
Uses of MultiDataSet in org.nd4j.linalg.dataset
Classes in org.nd4j.linalg.dataset that implement MultiDataSet Modifier and Type Class Description classMultiDataSetFields in org.nd4j.linalg.dataset declared as MultiDataSet Modifier and Type Field Description protected MultiDataSetAsyncMultiDataSetIterator. nextElementprotected MultiDataSetAsyncMultiDataSetIterator. terminatorFields in org.nd4j.linalg.dataset with type parameters of type MultiDataSet Modifier and Type Field Description protected BlockingQueue<MultiDataSet>AsyncMultiDataSetIterator. bufferMethods in org.nd4j.linalg.dataset that return MultiDataSet Modifier and Type Method Description MultiDataSetAsyncMultiDataSetIterator. next()Returns the next element in the iteration.MultiDataSetAsyncMultiDataSetIterator. next(int num)Like the standard next method but allows a customizable number of examples returnedMultiDataSetDataSet. toMultiDataSet()Methods in org.nd4j.linalg.dataset that return types with arguments of type MultiDataSet Modifier and Type Method Description List<MultiDataSet>MultiDataSet. asList()Method parameters in org.nd4j.linalg.dataset with type arguments of type MultiDataSet Modifier and Type Method Description static MultiDataSetMultiDataSet. merge(Collection<? extends MultiDataSet> toMerge)Merge a collection of MultiDataSet objects into a single MultiDataSet.Constructors in org.nd4j.linalg.dataset with parameters of type MultiDataSet Constructor Description AsyncPrefetchThread(@NonNull BlockingQueue<MultiDataSet> queue, @NonNull MultiDataSetIterator iterator, @NonNull MultiDataSet terminator, int deviceId)Constructor parameters in org.nd4j.linalg.dataset with type arguments of type MultiDataSet Constructor Description AsyncMultiDataSetIterator(MultiDataSetIterator iterator, int queueSize, BlockingQueue<MultiDataSet> queue)AsyncMultiDataSetIterator(MultiDataSetIterator iterator, int queueSize, BlockingQueue<MultiDataSet> queue, boolean useWorkspace)AsyncMultiDataSetIterator(MultiDataSetIterator iterator, int queueSize, BlockingQueue<MultiDataSet> queue, boolean useWorkspace, DataSetCallback callback)AsyncMultiDataSetIterator(MultiDataSetIterator iterator, int queueSize, BlockingQueue<MultiDataSet> queue, boolean useWorkspace, DataSetCallback callback, Integer deviceId)AsyncPrefetchThread(@NonNull BlockingQueue<MultiDataSet> queue, @NonNull MultiDataSetIterator iterator, @NonNull MultiDataSet terminator, int deviceId) -
Uses of MultiDataSet in org.nd4j.linalg.dataset.adapter
Methods in org.nd4j.linalg.dataset.adapter that return MultiDataSet Modifier and Type Method Description MultiDataSetMultiDataSetIteratorAdapter. next()MultiDataSetMultiDataSetIteratorAdapter. next(int i)MultiDataSetSingletonMultiDataSetIterator. next()MultiDataSetSingletonMultiDataSetIterator. next(int num)Constructors in org.nd4j.linalg.dataset.adapter with parameters of type MultiDataSet Constructor Description SingletonMultiDataSetIterator(MultiDataSet multiDataSet) -
Uses of MultiDataSet in org.nd4j.linalg.dataset.api
Methods in org.nd4j.linalg.dataset.api that return MultiDataSet Modifier and Type Method Description MultiDataSetMultiDataSet. copy()Clone the datasetMultiDataSetDataSet. toMultiDataSet()Methods in org.nd4j.linalg.dataset.api that return types with arguments of type MultiDataSet Modifier and Type Method Description List<MultiDataSet>MultiDataSet. asList()SplitV the MultiDataSet into a list of individual examples.Methods in org.nd4j.linalg.dataset.api with parameters of type MultiDataSet Modifier and Type Method Description voidMultiDataSetPreProcessor. preProcess(MultiDataSet multiDataSet)Preprocess the MultiDataSet -
Uses of MultiDataSet in org.nd4j.linalg.dataset.api.iterator
Methods in org.nd4j.linalg.dataset.api.iterator that return MultiDataSet Modifier and Type Method Description MultiDataSet[]BlockMultiDataSetIterator. next(int maxDatasets)This method tries to fetch specified number of DataSets and returns themMultiDataSetMultiDataSetIterator. next(int num)Fetch the next 'num' examples.MultiDataSetTestMultiDataSetIterator. next()MultiDataSetTestMultiDataSetIterator. next(int num)MultiDataSetParallelMultiDataSetIterator. nextFor()Returns next DataSet for attached consumerMultiDataSetParallelMultiDataSetIterator. nextFor(int consumer)Returns next DataSet for given consumerConstructors in org.nd4j.linalg.dataset.api.iterator with parameters of type MultiDataSet Constructor Description TestMultiDataSetIterator(int batch, MultiDataSet... dataset)Makes an iterator from the given datasets. -
Uses of MultiDataSet in org.nd4j.linalg.dataset.api.preprocessor
Methods in org.nd4j.linalg.dataset.api.preprocessor with parameters of type MultiDataSet Modifier and Type Method Description voidAbstractMultiDataSetNormalizer. fit(@NonNull MultiDataSet dataSet)Fit a MultiDataSet (only compute based on the statistics from thisMultiDataSet)voidImageMultiPreProcessingScaler. fit(MultiDataSet dataSet)voidMultiNormalizerHybrid. fit(@NonNull MultiDataSet dataSet)Fit a MultiDataSet (only compute based on the statistics from this dataset)voidAbstractMultiDataSetNormalizer. preProcess(@NonNull MultiDataSet toPreProcess)Pre process a MultiDataSetvoidCompositeMultiDataSetPreProcessor. preProcess(MultiDataSet multiDataSet)voidImageMultiPreProcessingScaler. preProcess(MultiDataSet multiDataSet)voidMultiDataNormalization. preProcess(MultiDataSet multiDataSet)voidMultiNormalizerHybrid. preProcess(@NonNull MultiDataSet data)voidAbstractMultiDataSetNormalizer. revert(@NonNull MultiDataSet data)Revert the data to what it was before transformvoidImageMultiPreProcessingScaler. revert(MultiDataSet toRevert)voidMultiNormalizerHybrid. revert(@NonNull MultiDataSet data)Undo (revert) the normalization applied by this DataNormalization instance (arrays are modified in-place)voidAbstractMultiDataSetNormalizer. transform(@NonNull MultiDataSet toPreProcess)voidImageMultiPreProcessingScaler. transform(MultiDataSet toPreProcess)voidMultiNormalizerHybrid. transform(@NonNull MultiDataSet data)Transform the dataset -
Uses of MultiDataSet in org.nd4j.linalg.dataset.api.preprocessor.classimbalance
Methods in org.nd4j.linalg.dataset.api.preprocessor.classimbalance with parameters of type MultiDataSet Modifier and Type Method Description voidUnderSamplingByMaskingMultiDataSetPreProcessor. preProcess(MultiDataSet multiDataSet) -
Uses of MultiDataSet in org.nd4j.linalg.dataset.callbacks
Methods in org.nd4j.linalg.dataset.callbacks with parameters of type MultiDataSet Modifier and Type Method Description voidDataSetCallback. call(MultiDataSet multiDataSet)voidDefaultCallback. call(MultiDataSet multiDataSet)
-