org.apache.iceberg.arrow.vectorized

Class VectorizedTableScanIterable

java.lang.Object

org.apache.iceberg.io.CloseableGroup

org.apache.iceberg.arrow.vectorized.VectorizedTableScanIterable

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, java.lang.Iterable<ColumnarBatch>, org.apache.iceberg.io.CloseableIterable<ColumnarBatch>

public class VectorizedTableScanIterable
extends org.apache.iceberg.io.CloseableGroup
implements org.apache.iceberg.io.CloseableIterable<ColumnarBatch>

A vectorized implementation of the Iceberg reader that iterates over the table scan. See ArrowReader for details.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.iceberg.io.CloseableIterable

org.apache.iceberg.io.CloseableIterable.ConcatCloseableIterable<E>

Constructor Summary

Constructors

Constructor and Description
VectorizedTableScanIterable(org.apache.iceberg.TableScan scan) Create a new instance using default values for batchSize and reuseContainers.
VectorizedTableScanIterable(org.apache.iceberg.TableScan scan, int batchSize, boolean reuseContainers) Create a new instance.

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.iceberg.io.CloseableIterator<ColumnarBatch>	iterator()

Methods inherited from class org.apache.iceberg.io.CloseableGroup

addCloseable, addCloseable, setSuppressCloseFailure

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.io.CloseableIterable

combine, concat, count, empty, filter, filter, transform, whenComplete, withNoopClose, withNoopClose

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

VectorizedTableScanIterable

public VectorizedTableScanIterable(org.apache.iceberg.TableScan scan)

Create a new instance using default values for batchSize and reuseContainers. The batchSize is set to BATCH_SIZE_IN_NUM_ROWS and reuseContainers is set to false.

VectorizedTableScanIterable

public VectorizedTableScanIterable(org.apache.iceberg.TableScan scan,
                                   int batchSize,
                                   boolean reuseContainers)

Create a new instance.

See ArrowReader(TableScan, int, boolean) for details.

Method Detail

iterator

public org.apache.iceberg.io.CloseableIterator<ColumnarBatch> iterator()

Specified by:

iterator in interface java.lang.Iterable<ColumnarBatch>

Specified by:

iterator in interface org.apache.iceberg.io.CloseableIterable<ColumnarBatch>

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Overrides:

close in class org.apache.iceberg.io.CloseableGroup

Throws:

java.io.IOException