org.apache.arrow.dataset.source

Interface DatasetFactory

All Superinterfaces:

AutoCloseable

All Known Implementing Classes:

FileSystemDatasetFactory, NativeDatasetFactory

public interface DatasetFactory
extends AutoCloseable

DatasetFactory provides a way to inspect a Dataset potential schema before materializing it. Thus, the user can peek the schema for data sources and decide on a unified schema.

Method Summary

Modifier and Type	Method and Description
Dataset	finish() Create a Dataset with auto-inferred schema.
Dataset	finish(Schema schema) Create a Dataset with predefined schema.
Schema	inspect() Get unified schema for the resulting Dataset.

Methods inherited from interface java.lang.AutoCloseable

close

Method Detail

inspect

Schema inspect()

Get unified schema for the resulting Dataset.

Returns:

the schema object inspected

finish

Dataset finish()

Create a Dataset with auto-inferred schema. Which means, the schema of the resulting Dataset will be the same with calling inspect() manually.

Returns:

the Dataset instance

finish

Dataset finish(Schema schema)

Create a Dataset with predefined schema. Schema inference will not be performed.

Parameters:

schema - a predefined schema

Returns:

the Dataset instance