org.apache.paimon.format.parquet

类 ParquetUtil

java.lang.Object

org.apache.paimon.format.parquet.ParquetUtil

public class ParquetUtil
extends Object

Parquet utilities that support to extract the metadata, assert expected stats, etc.

构造器概要

构造器

构造器和说明
ParquetUtil()

方法概要

限定符和类型	方法和说明
static org.apache.paimon.utils.Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,org.apache.paimon.format.SimpleStatsExtractor.FileInfo>	extractColumnStats(org.apache.paimon.fs.FileIO fileIO, org.apache.paimon.fs.Path path) Extract stats from specified Parquet files path.
static ParquetFileReader	getParquetReader(org.apache.paimon.fs.FileIO fileIO, org.apache.paimon.fs.Path path) Generate ParquetFileReader instance to read the Parquet files at the given path.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ParquetUtil

public ParquetUtil()

方法详细资料

extractColumnStats

public static org.apache.paimon.utils.Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,org.apache.paimon.format.SimpleStatsExtractor.FileInfo> extractColumnStats(org.apache.paimon.fs.FileIO fileIO,
                                                                                                                                                                                     org.apache.paimon.fs.Path path)
                                                                                                                                                                              throws IOException

Extract stats from specified Parquet files path.

参数:

path - the path of parquet files to be read

返回:

result sets as map, key is column name, value is statistics (for example, null count, minimum value, maximum value)

抛出:

IOException

getParquetReader

public static ParquetFileReader getParquetReader(org.apache.paimon.fs.FileIO fileIO,
                                                 org.apache.paimon.fs.Path path)
                                          throws IOException

Generate ParquetFileReader instance to read the Parquet files at the given path.

参数:

path - the path of parquet files to be read

返回:

parquet reader, used for reading footer, status, etc.

抛出:

IOException