org.apache.parquet.avro

Class AvroReadSupport<T>

java.lang.Object

org.apache.parquet.hadoop.api.ReadSupport<T>

org.apache.parquet.avro.AvroReadSupport<T>

Type Parameters:

T - the Java type of records created by this ReadSupport

public class AvroReadSupport<T>
extends ReadSupport<T>

Avro implementation of ReadSupport for avro generic, specific, and reflect models. Use AvroParquetReader or AvroParquetInputFormat rather than using this class directly.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.api.ReadSupport

ReadSupport.ReadContext

Field Summary

Fields

Modifier and Type	Field and Description
static String	AVRO_COMPATIBILITY
static String	AVRO_DATA_SUPPLIER
static boolean	AVRO_DEFAULT_COMPATIBILITY
static String	AVRO_REQUESTED_PROJECTION
static String	READ_INT96_AS_FIXED
static boolean	READ_INT96_AS_FIXED_DEFAULT

Fields inherited from class org.apache.parquet.hadoop.api.ReadSupport

PARQUET_READ_SCHEMA

Constructor Summary

Constructors

Constructor and Description
AvroReadSupport()
AvroReadSupport(org.apache.avro.generic.GenericData model)

Method Summary

Modifier and Type	Method and Description
ReadSupport.ReadContext	init(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema)
ReadSupport.ReadContext	init(ParquetConfiguration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema)
RecordMaterializer<T>	prepareForRead(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema, ReadSupport.ReadContext readContext)
RecordMaterializer<T>	prepareForRead(ParquetConfiguration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema, ReadSupport.ReadContext readContext)
static void	setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration, Class<? extends AvroDataSupplier> clazz)
static void	setAvroReadSchema(org.apache.hadoop.conf.Configuration configuration, org.apache.avro.Schema avroReadSchema)
static void	setRequestedProjection(org.apache.hadoop.conf.Configuration configuration, org.apache.avro.Schema requestedProjection)

Methods inherited from class org.apache.parquet.hadoop.api.ReadSupport

getSchemaForRead, getSchemaForRead, init

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

AVRO_REQUESTED_PROJECTION

public static final String AVRO_REQUESTED_PROJECTION

See Also:

Constant Field Values

AVRO_DATA_SUPPLIER

public static final String AVRO_DATA_SUPPLIER

See Also:

Constant Field Values

AVRO_COMPATIBILITY

public static final String AVRO_COMPATIBILITY

See Also:

Constant Field Values

AVRO_DEFAULT_COMPATIBILITY

public static final boolean AVRO_DEFAULT_COMPATIBILITY

See Also:

Constant Field Values

READ_INT96_AS_FIXED

public static final String READ_INT96_AS_FIXED

See Also:

Constant Field Values

READ_INT96_AS_FIXED_DEFAULT

public static final boolean READ_INT96_AS_FIXED_DEFAULT

See Also:

Constant Field Values

Constructor Detail

AvroReadSupport

public AvroReadSupport()

AvroReadSupport

public AvroReadSupport(org.apache.avro.generic.GenericData model)

Method Detail

setRequestedProjection

public static void setRequestedProjection(org.apache.hadoop.conf.Configuration configuration,
                                          org.apache.avro.Schema requestedProjection)

Parameters:

configuration - a configuration

requestedProjection - the requested projection schema

See Also:

AvroParquetInputFormat.setRequestedProjection(org.apache.hadoop.mapreduce.Job, org.apache.avro.Schema)

setAvroReadSchema

public static void setAvroReadSchema(org.apache.hadoop.conf.Configuration configuration,
                                     org.apache.avro.Schema avroReadSchema)

Parameters:

configuration - a configuration

avroReadSchema - the read schema

See Also:

AvroParquetInputFormat.setAvroReadSchema(org.apache.hadoop.mapreduce.Job, org.apache.avro.Schema)

setAvroDataSupplier

public static void setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration,
                                       Class<? extends AvroDataSupplier> clazz)

init

public ReadSupport.ReadContext init(org.apache.hadoop.conf.Configuration configuration,
                                    Map<String,String> keyValueMetaData,
                                    MessageType fileSchema)

Overrides:

init in class ReadSupport<T>

init

public ReadSupport.ReadContext init(ParquetConfiguration configuration,
                                    Map<String,String> keyValueMetaData,
                                    MessageType fileSchema)

Overrides:

init in class ReadSupport<T>

prepareForRead

public RecordMaterializer<T> prepareForRead(org.apache.hadoop.conf.Configuration configuration,
                                            Map<String,String> keyValueMetaData,
                                            MessageType fileSchema,
                                            ReadSupport.ReadContext readContext)

Specified by:

prepareForRead in class ReadSupport<T>

prepareForRead

public RecordMaterializer<T> prepareForRead(ParquetConfiguration configuration,
                                            Map<String,String> keyValueMetaData,
                                            MessageType fileSchema,
                                            ReadSupport.ReadContext readContext)

Overrides:

prepareForRead in class ReadSupport<T>