ai.djl.training.dataset

Class RandomAccessDataset.BaseBuilder<T extends RandomAccessDataset.BaseBuilder>

java.lang.Object

ai.djl.training.dataset.RandomAccessDataset.BaseBuilder<T>

Direct Known Subclasses:

ArrayDataset.Builder

Enclosing class:

RandomAccessDataset

public abstract static class RandomAccessDataset.BaseBuilder<T extends RandomAccessDataset.BaseBuilder>
extends java.lang.Object

The Builder to construct a RandomAccessDataset.

Field Summary

Fields

Modifier and Type	Field and Description
protected Batchifier	batchifier
protected Device	device
protected java.util.concurrent.ExecutorService	executor
protected long	maxIteration
protected Pipeline	pipeline
protected int	prefetchNumber
protected Sampler	sampler
protected Pipeline	targetPipeline

Constructor Summary

Constructors

Constructor and Description
BaseBuilder()

Method Summary

Modifier and Type	Method and Description
Sampler	getSampler() Gets the Sampler for the dataset.
T	optBatchier(Batchifier batchier) Sets the Batchifier for the dataset.
T	optDevice(Device device) Sets the Device.
T	optExcutor(java.util.concurrent.ExecutorService executor, int prefetchNumber) Sets the ExecutorService to spawn threads to fetch data.
T	optMaxIteration(long maxIteration) Sets the maximum number of iterations.
T	optPipeline(Pipeline pipeline) Sets the Pipeline of Transform to be applied on the data.
T	optTargetPipeline(Pipeline targetPipeline) Sets the Pipeline of Transform to be applied on the labels.
protected abstract T	self() Returns this {code Builder} object.
T	setSampling(int batchSize, boolean random) Sets the Sampler with the given batch size.
T	setSampling(int batchSize, boolean random, boolean dropLast) Sets the Sampler with the given batch size.
T	setSampling(Sampler sampler) Sets the Sampler for the dataset.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sampler

protected Sampler sampler

batchifier

protected Batchifier batchifier

pipeline

protected Pipeline pipeline

targetPipeline

protected Pipeline targetPipeline

executor

protected java.util.concurrent.ExecutorService executor

prefetchNumber

protected int prefetchNumber

maxIteration

protected long maxIteration

device

protected Device device

Constructor Detail

BaseBuilder

public BaseBuilder()

Method Detail

getSampler

public Sampler getSampler()

Gets the Sampler for the dataset.

Returns:

the Sampler

setSampling

public T setSampling(int batchSize,
                     boolean random)

Sets the Sampler with the given batch size.

Parameters:

batchSize - the batch size

random - whether the sampling has to be random

Returns:

this BaseBuilder

setSampling

public T setSampling(int batchSize,
                     boolean random,
                     boolean dropLast)

Sets the Sampler with the given batch size.

Parameters:

batchSize - the batch size

random - whether the sampling has to be random

dropLast - whether to drop the last incomplete batch

Returns:

this BaseBuilder

setSampling

public T setSampling(Sampler sampler)

Sets the Sampler for the dataset.

Parameters:

sampler - the Sampler to be set

Returns:

this BaseBuilder

optBatchier

public T optBatchier(Batchifier batchier)

Sets the Batchifier for the dataset.

Parameters:

batchier - the Batchifier to be set

Returns:

this BaseBuilder

optPipeline

public T optPipeline(Pipeline pipeline)

Sets the Pipeline of Transform to be applied on the data.

Parameters:

pipeline - the Pipeline of Transform to be applied on the data

Returns:

this BaseBuilder

optTargetPipeline

public T optTargetPipeline(Pipeline targetPipeline)

Sets the Pipeline of Transform to be applied on the labels.

Parameters:

targetPipeline - the Pipeline of Transform to be applied on the labels

Returns:

this BaseBuilder

optExcutor

public T optExcutor(java.util.concurrent.ExecutorService executor,
                    int prefetchNumber)

Sets the ExecutorService to spawn threads to fetch data.

Parameters:

executor - the ExecutorService to spawn threads

prefetchNumber - the number of samples to prefetch at once

Returns:

this BaseBuilder

optDevice

public T optDevice(Device device)

Sets the Device.

Parameters:

device - the device

Returns:

this BaseBuilder

optMaxIteration

public T optMaxIteration(long maxIteration)

Sets the maximum number of iterations.

Parameters:

maxIteration - the maximum number of iterations

Returns:

this BaseBuilder

self

protected abstract T self()

Returns this {code Builder} object.

Returns:

this BaseBuilder