org.apache.parquet.avro

Class AvroParquetReader<T>

java.lang.Object

org.apache.parquet.hadoop.ParquetReader<T>

org.apache.parquet.avro.AvroParquetReader<T>

Type Parameters:

T - the Java type of records created by this reader

All Implemented Interfaces:

Closeable, AutoCloseable

public class AvroParquetReader<T>
extends ParquetReader<T>

Read Avro records from a Parquet file.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AvroParquetReader.Builder<T>

Constructor Summary

Constructors

Constructor and Description
AvroParquetReader(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path file) Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.
AvroParquetReader(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path file, UnboundRecordFilter unboundRecordFilter) Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.
AvroParquetReader(org.apache.hadoop.fs.Path file) Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.
AvroParquetReader(org.apache.hadoop.fs.Path file, UnboundRecordFilter unboundRecordFilter) Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Method Summary

Modifier and Type	Method and Description
static <T> AvroParquetReader.Builder<T>	builder(InputFile file)
static <T> AvroParquetReader.Builder<T>	builder(InputFile file, ParquetConfiguration conf)
static <T> AvroParquetReader.Builder<T>	builder(org.apache.hadoop.fs.Path file) Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.
static ParquetReader<org.apache.avro.generic.GenericRecord>	genericRecordReader(InputFile file) Convenience method for creating a ParquetReader which uses Avro GenericData objects to store data from reads.
static ParquetReader<org.apache.avro.generic.GenericRecord>	genericRecordReader(InputFile file, ParquetConfiguration conf) Convenience method for creating a ParquetReader which uses Avro GenericData objects to store data from reads.
static ParquetReader<org.apache.avro.generic.GenericRecord>	genericRecordReader(org.apache.hadoop.fs.Path file) Deprecated. will be removed in 2.0.0; use genericRecordReader(InputFile) instead.

Methods inherited from class org.apache.parquet.hadoop.ParquetReader

builder, close, getCurrentRowIndex, read, read, read

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroParquetReader

@Deprecated
public AvroParquetReader(org.apache.hadoop.fs.Path file)
                              throws IOException

Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Parameters:

file - a file path

Throws:

IOException - if there is an error while reading

AvroParquetReader

@Deprecated
public AvroParquetReader(org.apache.hadoop.fs.Path file,
                                     UnboundRecordFilter unboundRecordFilter)
                              throws IOException

Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Parameters:

file - a file path

unboundRecordFilter - an unbound record filter (from the old filter API)

Throws:

IOException - if there is an error while reading

AvroParquetReader

@Deprecated
public AvroParquetReader(org.apache.hadoop.conf.Configuration conf,
                                     org.apache.hadoop.fs.Path file)
                              throws IOException

Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Parameters:

conf - a configuration

file - a file path

Throws:

IOException - if there is an error while reading

AvroParquetReader

@Deprecated
public AvroParquetReader(org.apache.hadoop.conf.Configuration conf,
                                     org.apache.hadoop.fs.Path file,
                                     UnboundRecordFilter unboundRecordFilter)
                              throws IOException

Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Parameters:

conf - a configuration

file - a file path

unboundRecordFilter - an unbound record filter (from the old filter API)

Throws:

IOException - if there is an error while reading

Method Detail

builder

@Deprecated
public static <T> AvroParquetReader.Builder<T> builder(org.apache.hadoop.fs.Path file)

Deprecated. will be removed in 2.0.0; use builder(InputFile) instead.

Type Parameters:

T - the Java type of records to read from the file

Parameters:

file - a file path

Returns:

an Avro reader builder

builder

public static <T> AvroParquetReader.Builder<T> builder(InputFile file)

builder

public static <T> AvroParquetReader.Builder<T> builder(InputFile file,
                                                       ParquetConfiguration conf)

genericRecordReader

public static ParquetReader<org.apache.avro.generic.GenericRecord> genericRecordReader(InputFile file)
                                                                                throws IOException

Convenience method for creating a ParquetReader which uses Avro GenericData objects to store data from reads.

Parameters:

file - The location to read data from

Returns:

A ParquetReader which reads data as Avro GenericData

Throws:

IOException - if the InputFile has been closed, or if some other I/O error occurs

genericRecordReader

public static ParquetReader<org.apache.avro.generic.GenericRecord> genericRecordReader(InputFile file,
                                                                                       ParquetConfiguration conf)
                                                                                throws IOException

Convenience method for creating a ParquetReader which uses Avro GenericData objects to store data from reads.

Parameters:

file - The location to read data from

conf - The configuration to use

Returns:

A ParquetReader which reads data as Avro GenericData

Throws:

IOException - if the InputFile has been closed, or if some other I/O error occurs

genericRecordReader

@Deprecated
public static ParquetReader<org.apache.avro.generic.GenericRecord> genericRecordReader(org.apache.hadoop.fs.Path file)
                                                                                            throws IOException

Deprecated. will be removed in 2.0.0; use genericRecordReader(InputFile) instead.

Convenience method for creating a ParquetReader which uses Avro GenericData objects to store data from reads.

Parameters:

file - The location to read data from

Returns:

A ParquetReader which reads data as Avro GenericData

Throws:

IOException - if the InputFile has been closed, or if some other I/O error occurs