org.apache.hudi.table.format.cow.vector.reader

Class Int64TimestampColumnReader

java.lang.Object

org.apache.hudi.table.format.cow.vector.reader.AbstractColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

org.apache.hudi.table.format.cow.vector.reader.Int64TimestampColumnReader

All Implemented Interfaces:

org.apache.flink.formats.parquet.vector.reader.ColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

public class Int64TimestampColumnReader
extends AbstractColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

Timestamp ColumnReader that supports INT64 8 bytes, TIMESTAMP_MILLIS is the deprecated ConvertedType counterpart of a TIMESTAMP logical type that is UTC normalized and has MILLIS precision.

See https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#timestamp TIMESTAMP_MILLIS and TIMESTAMP_MICROS are the deprecated ConvertedType.

Field Summary

Fields inherited from class org.apache.hudi.table.format.cow.vector.reader.AbstractColumnReader

descriptor, dictionary, maxDefLevel, runLenDecoder

Constructor Summary

Constructors

Constructor and Description
Int64TimestampColumnReader(boolean utcTimestamp, org.apache.parquet.column.ColumnDescriptor descriptor, org.apache.parquet.column.page.PageReader pageReader, int precision)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.table.data.TimestampData	decodeInt64ToTimestamp(boolean utcTimestamp, org.apache.parquet.column.Dictionary dictionary, int id, ChronoUnit unit)
protected void	readBatch(int rowId, int num, org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector column) Read batch from AbstractColumnReader.runLenDecoder and AbstractColumnReader.dataInputStream.
protected void	readBatchFromDictionaryIds(int rowId, int num, org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector column, org.apache.flink.table.data.columnar.vector.writable.WritableIntVector dictionaryIds) Decode dictionary ids to data.
protected boolean	supportLazyDecode() Support lazy dictionary ids decode.

Methods inherited from class org.apache.hudi.table.format.cow.vector.reader.AbstractColumnReader

afterReadPage, checkTypeName, readToVector

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Int64TimestampColumnReader

public Int64TimestampColumnReader(boolean utcTimestamp,
                                  org.apache.parquet.column.ColumnDescriptor descriptor,
                                  org.apache.parquet.column.page.PageReader pageReader,
                                  int precision)
                           throws IOException

Throws:

IOException

Method Detail

supportLazyDecode

protected boolean supportLazyDecode()

Description copied from class: AbstractColumnReader

Support lazy dictionary ids decode. See more in ParquetDictionary. If return false, we will decode all the data first.

Overrides:

supportLazyDecode in class AbstractColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

readBatch

protected void readBatch(int rowId,
                         int num,
                         org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector column)

Description copied from class: AbstractColumnReader

Read batch from AbstractColumnReader.runLenDecoder and AbstractColumnReader.dataInputStream.

Specified by:

readBatch in class AbstractColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

readBatchFromDictionaryIds

protected void readBatchFromDictionaryIds(int rowId,
                                          int num,
                                          org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector column,
                                          org.apache.flink.table.data.columnar.vector.writable.WritableIntVector dictionaryIds)

Description copied from class: AbstractColumnReader

Decode dictionary ids to data. From AbstractColumnReader.runLenDecoder and AbstractColumnReader.dictionaryIdsDecoder.

Specified by:

readBatchFromDictionaryIds in class AbstractColumnReader<org.apache.flink.table.data.columnar.vector.writable.WritableTimestampVector>

decodeInt64ToTimestamp

public static org.apache.flink.table.data.TimestampData decodeInt64ToTimestamp(boolean utcTimestamp,
                                                                               org.apache.parquet.column.Dictionary dictionary,
                                                                               int id,
                                                                               ChronoUnit unit)