org.apache.hudi.table.format.cow.vector.reader

Class ParquetColumnarRowSplitReader

java.lang.Object

org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParquetColumnarRowSplitReader
extends Object
implements Closeable

This reader is used to read a VectorizedColumnBatch from input split.

Note: Reference Flink release 1.11.2 org.apache.flink.formats.parquet.vector.ParquetColumnarRowSplitReader because it is package scope.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	ParquetColumnarRowSplitReader.ColumnBatchGenerator Interface to gen VectorizedColumnBatch.

Constructor Summary

Constructors

Constructor and Description

ParquetColumnarRowSplitReader(boolean utcTimestamp, boolean caseSensitive, org.apache.hadoop.conf.Configuration conf, org.apache.flink.table.types.logical.LogicalType[] selectedTypes, String[] selectedFieldNames, ParquetColumnarRowSplitReader.ColumnBatchGenerator generator, int batchSize, org.apache.hadoop.fs.Path path, long splitStart, long splitLength, org.apache.parquet.filter2.predicate.FilterPredicate filterPredicate, org.apache.parquet.filter.UnboundRecordFilter recordFilter)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.flink.table.data.RowData	nextRecord()
boolean	reachedEnd() Method used to check if the end of the input is reached.
void	seekToRow(long rowCount) Seek to a particular row number.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetColumnarRowSplitReader

public ParquetColumnarRowSplitReader(boolean utcTimestamp,
                                     boolean caseSensitive,
                                     org.apache.hadoop.conf.Configuration conf,
                                     org.apache.flink.table.types.logical.LogicalType[] selectedTypes,
                                     String[] selectedFieldNames,
                                     ParquetColumnarRowSplitReader.ColumnBatchGenerator generator,
                                     int batchSize,
                                     org.apache.hadoop.fs.Path path,
                                     long splitStart,
                                     long splitLength,
                                     org.apache.parquet.filter2.predicate.FilterPredicate filterPredicate,
                                     org.apache.parquet.filter.UnboundRecordFilter recordFilter)
                              throws IOException

Throws:

IOException

Method Detail

reachedEnd

public boolean reachedEnd()
                   throws IOException

Method used to check if the end of the input is reached.

Returns:

True if the end is reached, otherwise false.

Throws:

IOException - Thrown, if an I/O error occurred.

nextRecord

public org.apache.flink.table.data.RowData nextRecord()

seekToRow

public void seekToRow(long rowCount)
               throws IOException

Seek to a particular row number.

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException