org.apache.hudi.hadoop.realtime

Class AbstractRealtimeRecordReader

java.lang.Object

org.apache.hudi.hadoop.realtime.AbstractRealtimeRecordReader

Direct Known Subclasses:

HoodieEmptyRecordReader

public abstract class AbstractRealtimeRecordReader
extends Object

Record Reader implementation to merge fresh avro data with base parquet data, to support real time queries.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.mapred.JobConf	jobConf
protected Properties	payloadProps
protected RealtimeSplit	split
protected boolean	usesCustomPayload

Constructor Summary

Constructors

Constructor and Description
AbstractRealtimeRecordReader(RealtimeSplit split, org.apache.hadoop.mapred.JobConf job)

Method Summary

Modifier and Type	Method and Description
org.apache.avro.Schema	getHiveSchema()
org.apache.hadoop.mapred.JobConf	getJobConf()
org.apache.avro.Schema	getReaderSchema()
RealtimeSplit	getSplit()
org.apache.avro.Schema	getWriterSchema()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

split

protected final RealtimeSplit split

jobConf

protected final org.apache.hadoop.mapred.JobConf jobConf

usesCustomPayload

protected final boolean usesCustomPayload

payloadProps

protected Properties payloadProps

Constructor Detail

AbstractRealtimeRecordReader

public AbstractRealtimeRecordReader(RealtimeSplit split,
                                    org.apache.hadoop.mapred.JobConf job)

Method Detail

getReaderSchema

public org.apache.avro.Schema getReaderSchema()

getWriterSchema

public org.apache.avro.Schema getWriterSchema()

getHiveSchema

public org.apache.avro.Schema getHiveSchema()

getSplit

public RealtimeSplit getSplit()

getJobConf

public org.apache.hadoop.mapred.JobConf getJobConf()