Package org.apache.parquet.avro

Class AvroWriteSupport<T>

java.lang.Object

org.apache.parquet.hadoop.api.WriteSupport<T>

org.apache.parquet.avro.AvroWriteSupport<T>

public class AvroWriteSupport<T>
extends org.apache.parquet.hadoop.api.WriteSupport<T>

Avro implementation of WriteSupport for generic, specific, and reflect models. Use AvroParquetWriter or AvroParquetOutputFormat rather than using this class directly.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.api.WriteSupport

org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext, org.apache.parquet.hadoop.api.WriteSupport.WriteContext

Field Summary

Fields

Modifier and Type	Field	Description
static String	AVRO_DATA_SUPPLIER
static String	WRITE_FIXED_AS_INT96
static String	WRITE_OLD_LIST_STRUCTURE
static String	WRITE_PARQUET_UUID

Constructor Summary

Constructors

Constructor	Description
AvroWriteSupport()
AvroWriteSupport(org.apache.parquet.schema.MessageType schema, org.apache.avro.Schema avroSchema)	Deprecated. will be removed in 2.0.0
AvroWriteSupport(org.apache.parquet.schema.MessageType schema, org.apache.avro.Schema avroSchema, org.apache.avro.generic.GenericData model)

Method Summary

Modifier and Type	Method	Description
String	getName()
org.apache.parquet.hadoop.api.WriteSupport.WriteContext	init(org.apache.hadoop.conf.Configuration configuration)
void	prepareForWrite(org.apache.parquet.io.api.RecordConsumer recordConsumer)
static void	setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration, Class<? extends AvroDataSupplier> suppClass)
static void	setSchema(org.apache.hadoop.conf.Configuration configuration, org.apache.avro.Schema schema)
void	write(org.apache.avro.generic.IndexedRecord record)
void	write(T record)

Methods inherited from class org.apache.parquet.hadoop.api.WriteSupport

finalizeWrite

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

AVRO_DATA_SUPPLIER

public static final String AVRO_DATA_SUPPLIER

See Also:

Constant Field Values

WRITE_OLD_LIST_STRUCTURE

public static final String WRITE_OLD_LIST_STRUCTURE

See Also:

Constant Field Values

WRITE_PARQUET_UUID

public static final String WRITE_PARQUET_UUID

See Also:

Constant Field Values

WRITE_FIXED_AS_INT96

public static final String WRITE_FIXED_AS_INT96

See Also:

Constant Field Values

Constructor Detail

AvroWriteSupport

public AvroWriteSupport()

AvroWriteSupport

@Deprecated
public AvroWriteSupport(org.apache.parquet.schema.MessageType schema,
                        org.apache.avro.Schema avroSchema)

Deprecated.

will be removed in 2.0.0

Parameters:

schema - the write parquet schema

avroSchema - the write avro schema

AvroWriteSupport

public AvroWriteSupport(org.apache.parquet.schema.MessageType schema,
                        org.apache.avro.Schema avroSchema,
                        org.apache.avro.generic.GenericData model)

Method Detail

setAvroDataSupplier

public static void setAvroDataSupplier(org.apache.hadoop.conf.Configuration configuration,
                                       Class<? extends AvroDataSupplier> suppClass)

getName

public String getName()

Overrides:

getName in class org.apache.parquet.hadoop.api.WriteSupport<T>

setSchema

public static void setSchema(org.apache.hadoop.conf.Configuration configuration,
                             org.apache.avro.Schema schema)

Parameters:

configuration - a configuration

schema - the write schema

See Also:

AvroParquetOutputFormat.setSchema(org.apache.hadoop.mapreduce.Job, org.apache.avro.Schema)

init

public org.apache.parquet.hadoop.api.WriteSupport.WriteContext init(org.apache.hadoop.conf.Configuration configuration)

Specified by:

init in class org.apache.parquet.hadoop.api.WriteSupport<T>

prepareForWrite

public void prepareForWrite(org.apache.parquet.io.api.RecordConsumer recordConsumer)

Specified by:

prepareForWrite in class org.apache.parquet.hadoop.api.WriteSupport<T>

write

public void write(org.apache.avro.generic.IndexedRecord record)

write

public void write(T record)

Specified by:

write in class org.apache.parquet.hadoop.api.WriteSupport<T>