org.apache.paimon.format.orc

类 OrcReaderFactory

java.lang.Object

org.apache.paimon.format.orc.OrcReaderFactory

所有已实现的接口:

Serializable, org.apache.paimon.format.FormatReaderFactory

public class OrcReaderFactory
extends Object
implements org.apache.paimon.format.FormatReaderFactory

An ORC reader that produces a stream of ColumnarRow records.

另请参阅:

序列化表格

嵌套类概要

从接口继承的嵌套类/接口 org.apache.paimon.format.FormatReaderFactory

org.apache.paimon.format.FormatReaderFactory.Context

字段概要

字段

限定符和类型	字段和说明
protected int	batchSize
protected List<OrcFilters.Predicate>	conjunctPredicates
protected SerializableHadoopConfigWrapper	hadoopConfigWrapper
protected org.apache.orc.TypeDescription	schema

构造器概要

构造器

构造器和说明
OrcReaderFactory(org.apache.hadoop.conf.Configuration hadoopConfig, org.apache.paimon.types.RowType readType, List<OrcFilters.Predicate> conjunctPredicates, int batchSize)

方法概要

限定符和类型	方法和说明
static org.apache.orc.Reader	createReader(org.apache.hadoop.conf.Configuration conf, org.apache.paimon.fs.FileIO fileIO, org.apache.paimon.fs.Path path)
org.apache.paimon.format.orc.OrcReaderFactory.OrcVectorizedReader	createReader(org.apache.paimon.format.FormatReaderFactory.Context context)
org.apache.paimon.format.orc.OrcReaderFactory.OrcReaderBatch	createReaderBatch(org.apache.paimon.fs.Path filePath, org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch orcBatch, org.apache.paimon.utils.Pool.Recycler<org.apache.paimon.format.orc.OrcReaderFactory.OrcReaderBatch> recycler) Creates the OrcReaderBatch structure, which is responsible for holding the data structures that hold the batch data (column vectors, row arrays, ...) and the batch conversion from the ORC representation to the result format.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

hadoopConfigWrapper

protected final SerializableHadoopConfigWrapper hadoopConfigWrapper

schema

protected final org.apache.orc.TypeDescription schema

conjunctPredicates

protected final List<OrcFilters.Predicate> conjunctPredicates

batchSize

protected final int batchSize

构造器详细资料

OrcReaderFactory

public OrcReaderFactory(org.apache.hadoop.conf.Configuration hadoopConfig,
                        org.apache.paimon.types.RowType readType,
                        List<OrcFilters.Predicate> conjunctPredicates,
                        int batchSize)

参数:

hadoopConfig - the hadoop config for orc reader.

conjunctPredicates - the filter predicates that can be evaluated.

batchSize - the batch size of orc reader.

方法详细资料

createReader

public org.apache.paimon.format.orc.OrcReaderFactory.OrcVectorizedReader createReader(org.apache.paimon.format.FormatReaderFactory.Context context)
                                                                               throws IOException

指定者:

createReader 在接口中 org.apache.paimon.format.FormatReaderFactory

抛出:

IOException

createReaderBatch

public org.apache.paimon.format.orc.OrcReaderFactory.OrcReaderBatch createReaderBatch(org.apache.paimon.fs.Path filePath,
                                                                                      org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch orcBatch,
                                                                                      org.apache.paimon.utils.Pool.Recycler<org.apache.paimon.format.orc.OrcReaderFactory.OrcReaderBatch> recycler)

Creates the OrcReaderBatch structure, which is responsible for holding the data structures that hold the batch data (column vectors, row arrays, ...) and the batch conversion from the ORC representation to the result format.

createReader

public static org.apache.orc.Reader createReader(org.apache.hadoop.conf.Configuration conf,
                                                 org.apache.paimon.fs.FileIO fileIO,
                                                 org.apache.paimon.fs.Path path)
                                          throws IOException

抛出:

IOException