org.apache.gobblin.dataset.test

Class SimplePartitionableDatasetForTesting

java.lang.Object

org.apache.gobblin.dataset.test.SimplePartitionableDatasetForTesting

All Implemented Interfaces:

Dataset, PartitionableDataset<SimpleDatasetPartitionForTesting>, URNIdentified

public class SimplePartitionableDatasetForTesting
extends Object
implements PartitionableDataset<SimpleDatasetPartitionForTesting>

A PartitionableDataset that just returns a predefined set of SimpleDatasetPartitionForTesting used for testing.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.gobblin.dataset.PartitionableDataset

PartitionableDataset.DatasetPartition

Constructor Summary

Constructors

Constructor and Description
SimplePartitionableDatasetForTesting(String urn, List<SimpleDatasetPartitionForTesting> partitions)

Method Summary

Modifier and Type	Method and Description
String	datasetURN() URN for this dataset.
java.util.stream.Stream<SimpleDatasetPartitionForTesting>	getPartitions(int desiredCharacteristics, Comparator<SimpleDatasetPartitionForTesting> suggestedOrder) Get a stream of partitions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.dataset.Dataset

getUrn

Constructor Detail

SimplePartitionableDatasetForTesting

public SimplePartitionableDatasetForTesting(String urn,
                                            List<SimpleDatasetPartitionForTesting> partitions)

Method Detail

datasetURN

public String datasetURN()

Description copied from interface: Dataset

URN for this dataset.

Specified by:

datasetURN in interface Dataset

getPartitions

public java.util.stream.Stream<SimpleDatasetPartitionForTesting> getPartitions(int desiredCharacteristics,
                                                                               Comparator<SimpleDatasetPartitionForTesting> suggestedOrder)
                                                                        throws IOException

Description copied from interface: PartitionableDataset

Get a stream of partitions.

Specified by:

getPartitions in interface PartitionableDataset<SimpleDatasetPartitionForTesting>

Parameters:

desiredCharacteristics - desired Spliterator characteristics of this stream. The returned stream need not satisfy these characteristics, this argument merely implies that the caller will run optimally when those characteristics are present, allowing pushdown of those characteristics. For example Spliterator.SORTED can sometimes be pushed down at a cost, so the Dataset would only push it down if it is valuable for the caller.

suggestedOrder - suggested order of the partitions in the stream. Implementation may or may not return the entries in that order. If the entries are in that order, implementation should ensure the spliterator is annotated as such.

Returns:

a Stream over PartitionableDataset.DatasetPartitions in this dataset.

Throws:

IOException