org.apache.parquet.avro

Class HoodieAvroReadSupport<T>

java.lang.Object

org.apache.parquet.hadoop.api.ReadSupport<T>

org.apache.parquet.avro.AvroReadSupport<T>

org.apache.parquet.avro.HoodieAvroReadSupport<T>

public class HoodieAvroReadSupport<T>
extends org.apache.parquet.avro.AvroReadSupport<T>

Support to avro-record read parquet-log which written by spark-record. See the examples in TestMORDataSource#testRecordTypeCompatibilityWithParquetLog. Exception throw when schema end with map or list.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.api.ReadSupport

org.apache.parquet.hadoop.api.ReadSupport.ReadContext

Field Summary

Fields inherited from class org.apache.parquet.avro.AvroReadSupport

AVRO_COMPATIBILITY, AVRO_DATA_SUPPLIER, AVRO_DEFAULT_COMPATIBILITY, AVRO_REQUESTED_PROJECTION

Fields inherited from class org.apache.parquet.hadoop.api.ReadSupport

PARQUET_READ_SCHEMA

Constructor Summary

Constructors

Constructor and Description
HoodieAvroReadSupport()
HoodieAvroReadSupport(org.apache.avro.generic.GenericData model)

Method Summary

Modifier and Type	Method and Description
org.apache.parquet.hadoop.api.ReadSupport.ReadContext	init(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, org.apache.parquet.schema.MessageType fileSchema)

Methods inherited from class org.apache.parquet.avro.AvroReadSupport

prepareForRead, setAvroDataSupplier, setAvroReadSchema, setRequestedProjection

Methods inherited from class org.apache.parquet.hadoop.api.ReadSupport

getSchemaForRead, getSchemaForRead, init

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieAvroReadSupport

public HoodieAvroReadSupport(org.apache.avro.generic.GenericData model)

HoodieAvroReadSupport

public HoodieAvroReadSupport()

Method Detail

init

public org.apache.parquet.hadoop.api.ReadSupport.ReadContext init(org.apache.hadoop.conf.Configuration configuration,
                                                                  Map<String,String> keyValueMetaData,
                                                                  org.apache.parquet.schema.MessageType fileSchema)

Overrides:

init in class org.apache.parquet.avro.AvroReadSupport<T>