org.apache.parquet.avro

Class AvroWriteSupport<T>

java.lang.Object

org.apache.parquet.hadoop.api.WriteSupport<T>

org.apache.parquet.avro.AvroWriteSupport<T>

public class AvroWriteSupport<T>
extends WriteSupport<T>

Avro implementation of WriteSupport for generic, specific, and reflect models. Use AvroParquetWriter or AvroParquetOutputFormat rather than using this class directly.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.api.WriteSupport

WriteSupport.FinalizedWriteContext, WriteSupport.WriteContext

Field Summary

Fields

Modifier and Type	Field and Description
static String	AVRO_DATA_SUPPLIER
static String	WRITE_FIXED_AS_INT96
static String	WRITE_OLD_LIST_STRUCTURE
static String	WRITE_PARQUET_UUID

Constructor Summary

Constructors

Constructor and Description
AvroWriteSupport()
AvroWriteSupport(MessageType schema, org.apache.avro.Schema avroSchema) Deprecated. will be removed in 2.0.0
AvroWriteSupport(MessageType schema, org.apache.avro.Schema avroSchema, org.apache.avro.generic.GenericData model)

Method Summary

Modifier and Type	Method and Description
String	getName()
WriteSupport.WriteContext	init(org.apache.hadoop.conf.Configuration configuration)
WriteSupport.WriteContext	init(ParquetConfiguration configuration)
void	prepareForWrite(RecordConsumer recordConsumer)
static void	setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration, Class<? extends AvroDataSupplier> suppClass)
static void	setSchema(org.apache.hadoop.conf.Configuration configuration, org.apache.avro.Schema schema)
void	write(org.apache.avro.generic.IndexedRecord record)
void	write(T record)

Methods inherited from class org.apache.parquet.hadoop.api.WriteSupport

finalizeWrite

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

AVRO_DATA_SUPPLIER

public static final String AVRO_DATA_SUPPLIER

See Also:

Constant Field Values

WRITE_OLD_LIST_STRUCTURE

public static final String WRITE_OLD_LIST_STRUCTURE

See Also:

Constant Field Values

WRITE_PARQUET_UUID

public static final String WRITE_PARQUET_UUID

See Also:

Constant Field Values

WRITE_FIXED_AS_INT96

public static final String WRITE_FIXED_AS_INT96

See Also:

Constant Field Values

Constructor Detail

AvroWriteSupport

public AvroWriteSupport()

AvroWriteSupport

@Deprecated
public AvroWriteSupport(MessageType schema,
                                    org.apache.avro.Schema avroSchema)

Deprecated. will be removed in 2.0.0

Parameters:

schema - the write parquet schema

avroSchema - the write avro schema

AvroWriteSupport

public AvroWriteSupport(MessageType schema,
                        org.apache.avro.Schema avroSchema,
                        org.apache.avro.generic.GenericData model)

Method Detail

setAvroDataSupplier

public static void setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration,
                                       Class<? extends AvroDataSupplier> suppClass)

getName

public String getName()

Overrides:

getName in class WriteSupport<T>

setSchema

public static void setSchema(org.apache.hadoop.conf.Configuration configuration,
                             org.apache.avro.Schema schema)

Parameters:

configuration - a configuration

schema - the write schema

See Also:

AvroParquetOutputFormat.setSchema(org.apache.hadoop.mapreduce.Job, org.apache.avro.Schema)

init

public WriteSupport.WriteContext init(org.apache.hadoop.conf.Configuration configuration)

Specified by:

init in class WriteSupport<T>

init

public WriteSupport.WriteContext init(ParquetConfiguration configuration)

Overrides:

init in class WriteSupport<T>

prepareForWrite

public void prepareForWrite(RecordConsumer recordConsumer)

Specified by:

prepareForWrite in class WriteSupport<T>

write

public void write(org.apache.avro.generic.IndexedRecord record)

write

public void write(T record)

Specified by:

write in class WriteSupport<T>