org.tensorflow.op.core

Class AutoShardDataset

java.lang.Object

org.tensorflow.op.PrimitiveOp

org.tensorflow.op.core.AutoShardDataset

All Implemented Interfaces:

Op, Operand<Object>

public final class AutoShardDataset
extends PrimitiveOp
implements Operand<Object>

Creates a dataset that shards the input dataset.

Creates a dataset that shards the input dataset by num_workers, returning a sharded dataset for the index-th worker. This attempts to automatically shard a dataset by examining the Dataset graph and inserting a shard op before the inputs to a reader Dataset (e.g. CSVDataset, TFRecordDataset).

This dataset will throw a NotFound error if we cannot shard the dataset automatically.

Field Summary

Fields inherited from class org.tensorflow.op.PrimitiveOp

operation

Method Summary

Modifier and Type	Method and Description
Output<Object>	asOutput() Returns the symbolic handle of a tensor.
static AutoShardDataset	create(Scope scope, Operand<?> inputDataset, Operand<Long> numWorkers, Operand<Long> index, List<Class<?>> outputTypes, List<Shape> outputShapes) Factory method to create a class wrapping a new AutoShardDataset operation.
Output<?>	handle()

Methods inherited from class org.tensorflow.op.PrimitiveOp

equals, hashCode, op, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Method Detail

create

public static AutoShardDataset create(Scope scope,
                                      Operand<?> inputDataset,
                                      Operand<Long> numWorkers,
                                      Operand<Long> index,
                                      List<Class<?>> outputTypes,
                                      List<Shape> outputShapes)

Factory method to create a class wrapping a new AutoShardDataset operation.

Parameters:

scope - current scope

inputDataset - A variant tensor representing the input dataset.

numWorkers - A scalar representing the number of workers to distribute this dataset across.

index - A scalar representing the index of the current worker out of num_workers.

outputTypes -

outputShapes -

Returns:

a new instance of AutoShardDataset

handle

public Output<?> handle()

asOutput

public Output<Object> asOutput()

Description copied from interface: Operand

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is used to obtain a symbolic handle that represents the computation of the input.

Specified by:

asOutput in interface Operand<Object>

See Also:

OperationBuilder.addInput(Output)