org.apache.parquet.hadoop

Class ParquetReader<T>

java.lang.Object

org.apache.parquet.hadoop.ParquetReader<T>

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParquetReader<T>
extends Object
implements Closeable

Read records from a Parquet file. TODO: too many constructors (https://issues.apache.org/jira/browse/PARQUET-39)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetReader.Builder<T>

Constructor Summary

Constructors

Constructor and Description
ParquetReader(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path file, ReadSupport<T> readSupport) Deprecated. use builder(ReadSupport, Path)
ParquetReader(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path file, ReadSupport<T> readSupport, UnboundRecordFilter unboundRecordFilter) Deprecated. use builder(ReadSupport, Path)
ParquetReader(org.apache.hadoop.fs.Path file, ReadSupport<T> readSupport) Deprecated. use builder(ReadSupport, Path)
ParquetReader(org.apache.hadoop.fs.Path file, ReadSupport<T> readSupport, UnboundRecordFilter unboundRecordFilter) Deprecated. use builder(ReadSupport, Path)

Method Summary

Modifier and Type	Method and Description
static <T> ParquetReader.Builder<T>	builder(ReadSupport<T> readSupport, org.apache.hadoop.fs.Path path)
void	close()
long	getCurrentRowIndex()
T	read()
static <T> ParquetReader.Builder<T>	read(InputFile file)
static <T> ParquetReader.Builder<T>	read(InputFile file, ParquetConfiguration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetReader

@Deprecated
public ParquetReader(org.apache.hadoop.fs.Path file,
                                 ReadSupport<T> readSupport)
                          throws IOException

Deprecated. use builder(ReadSupport, Path)

Parameters:

file - the file to read

readSupport - to materialize records

Throws:

IOException - if there is an error while reading

ParquetReader

@Deprecated
public ParquetReader(org.apache.hadoop.conf.Configuration conf,
                                 org.apache.hadoop.fs.Path file,
                                 ReadSupport<T> readSupport)
                          throws IOException

Deprecated. use builder(ReadSupport, Path)

Parameters:

conf - the configuration

file - the file to read

readSupport - to materialize records

Throws:

IOException - if there is an error while reading

ParquetReader

@Deprecated
public ParquetReader(org.apache.hadoop.fs.Path file,
                                 ReadSupport<T> readSupport,
                                 UnboundRecordFilter unboundRecordFilter)
                          throws IOException

Deprecated. use builder(ReadSupport, Path)

Parameters:

file - the file to read

readSupport - to materialize records

unboundRecordFilter - the filter to use to filter records

Throws:

IOException - if there is an error while reading

ParquetReader

@Deprecated
public ParquetReader(org.apache.hadoop.conf.Configuration conf,
                                 org.apache.hadoop.fs.Path file,
                                 ReadSupport<T> readSupport,
                                 UnboundRecordFilter unboundRecordFilter)
                          throws IOException

Deprecated. use builder(ReadSupport, Path)

Parameters:

conf - the configuration

file - the file to read

readSupport - to materialize records

unboundRecordFilter - the filter to use to filter records

Throws:

IOException - if there is an error while reading

Method Detail

read

public T read()
       throws IOException

Returns:

the next record or null if finished

Throws:

IOException - if there is an error while reading

getCurrentRowIndex

public long getCurrentRowIndex()

Returns:

the row index of the last read row. If no row has been processed, returns -1.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

read

public static <T> ParquetReader.Builder<T> read(InputFile file)
                                         throws IOException

Throws:

IOException

read

public static <T> ParquetReader.Builder<T> read(InputFile file,
                                                ParquetConfiguration conf)
                                         throws IOException

Throws:

IOException

builder

public static <T> ParquetReader.Builder<T> builder(ReadSupport<T> readSupport,
                                                   org.apache.hadoop.fs.Path path)