org.apache.paimon.format.parquet.reader

类 ParquetSplitReaderUtil

java.lang.Object

org.apache.paimon.format.parquet.reader.ParquetSplitReaderUtil

public class ParquetSplitReaderUtil
extends Object

Util for generating ColumnReader.

构造器概要

构造器

构造器和说明
ParquetSplitReaderUtil()

方法概要

限定符和类型	方法和说明
static List<ParquetField>	buildFieldsList(List<org.apache.paimon.types.DataField> childrens, List<String> fieldNames, org.apache.parquet.io.MessageColumnIO columnIO)
static ColumnReader	createColumnReader(org.apache.paimon.types.DataType fieldType, org.apache.parquet.schema.Type type, List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors, org.apache.parquet.column.page.PageReadStore pages, ParquetField field, int depth)
static org.apache.paimon.data.columnar.writable.WritableColumnVector	createWritableColumnVector(int batchSize, org.apache.paimon.types.DataType fieldType, org.apache.parquet.schema.Type type, List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors, int depth)
static org.apache.parquet.io.ColumnIO	getArrayElementColumn(org.apache.parquet.io.ColumnIO columnIO)
static org.apache.parquet.io.GroupColumnIO	getMapKeyValueColumn(org.apache.parquet.io.GroupColumnIO groupColumnIO)
static org.apache.parquet.io.ColumnIO	lookupColumnByName(org.apache.parquet.io.GroupColumnIO groupColumnIO, String columnName) Parquet's column names are case in sensitive.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ParquetSplitReaderUtil

public ParquetSplitReaderUtil()

方法详细资料

createColumnReader

public static ColumnReader createColumnReader(org.apache.paimon.types.DataType fieldType,
                                              org.apache.parquet.schema.Type type,
                                              List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors,
                                              org.apache.parquet.column.page.PageReadStore pages,
                                              ParquetField field,
                                              int depth)
                                       throws IOException

抛出:

IOException

createWritableColumnVector

public static org.apache.paimon.data.columnar.writable.WritableColumnVector createWritableColumnVector(int batchSize,
                                                                                                       org.apache.paimon.types.DataType fieldType,
                                                                                                       org.apache.parquet.schema.Type type,
                                                                                                       List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors,
                                                                                                       int depth)

buildFieldsList

public static List<ParquetField> buildFieldsList(List<org.apache.paimon.types.DataField> childrens,
                                                 List<String> fieldNames,
                                                 org.apache.parquet.io.MessageColumnIO columnIO)

lookupColumnByName

public static org.apache.parquet.io.ColumnIO lookupColumnByName(org.apache.parquet.io.GroupColumnIO groupColumnIO,
                                                                String columnName)

Parquet's column names are case in sensitive. So when we look up columns we first check for exact match, and if that can not find we look for a case-insensitive match.

getMapKeyValueColumn

public static org.apache.parquet.io.GroupColumnIO getMapKeyValueColumn(org.apache.parquet.io.GroupColumnIO groupColumnIO)

getArrayElementColumn

public static org.apache.parquet.io.ColumnIO getArrayElementColumn(org.apache.parquet.io.ColumnIO columnIO)