org.apache.paimon.hive.mapred

类 PaimonRecordReader

java.lang.Object

org.apache.paimon.hive.mapred.PaimonRecordReader

所有已实现的接口:

org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

public class PaimonRecordReader
extends Object
implements org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

Base RecordReader for paimon. Reads KeyValues from data files and picks out InternalRow for Hive to consume.

NOTE: To support projection push down, when selectedColumns does not match columnNames this reader will still produce records of the original schema. However, columns not in selectedColumns will be null.

构造器概要

构造器

构造器和说明
PaimonRecordReader(org.apache.paimon.table.source.ReadBuilder readBuilder, PaimonInputSplit split, List<String> paimonColumns, List<String> hiveColumns, List<String> selectedColumns, String tagToPartField)

方法概要

限定符和类型	方法和说明
void	close()
Void	createKey()
static org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>	createRecordReader(PaimonInputSplit split, org.apache.hadoop.mapred.JobConf jobConf)
RowDataContainer	createValue()
long	getPos()
float	getProgress()
boolean	next(Void key, RowDataContainer value)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

PaimonRecordReader

public PaimonRecordReader(org.apache.paimon.table.source.ReadBuilder readBuilder,
                          PaimonInputSplit split,
                          List<String> paimonColumns,
                          List<String> hiveColumns,
                          List<String> selectedColumns,
                          @Nullable
                          String tagToPartField)
                   throws IOException

参数:

paimonColumns - columns stored in Paimon table

hiveColumns - columns Hive expects

selectedColumns - columns we really have to read

抛出:

IOException

方法详细资料

next

public boolean next(Void key,
                    RowDataContainer value)
             throws IOException

指定者:

next 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

抛出:

IOException

createKey

public Void createKey()

指定者:

createKey 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

createValue

public RowDataContainer createValue()

指定者:

createValue 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

getPos

public long getPos()
            throws IOException

指定者:

getPos 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

抛出:

IOException

close

public void close()
           throws IOException

指定者:

close 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

抛出:

IOException

getProgress

public float getProgress()
                  throws IOException

指定者:

getProgress 在接口中 org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer>

抛出:

IOException

createRecordReader

public static org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer> createRecordReader(PaimonInputSplit split,
                                                                                              org.apache.hadoop.mapred.JobConf jobConf)
                                                                                       throws IOException

抛出:

IOException