org.apache.hudi.io.hadoop

Class HoodieAvroParquetReader

java.lang.Object

org.apache.hudi.io.storage.HoodieAvroFileReader

org.apache.hudi.io.hadoop.HoodieAvroParquetReader

All Implemented Interfaces:

AutoCloseable, HoodieFileReader<org.apache.avro.generic.IndexedRecord>

public class HoodieAvroParquetReader
extends HoodieAvroFileReader

HoodieFileReader implementation for parquet format.

Constructor Summary

Constructors

Constructor and Description
HoodieAvroParquetReader(HoodieStorage storage, StoragePath path)

Method Summary

Modifier and Type	Method and Description
void	close()
Set<String>	filterRowKeys(Set<String> candidateRowKeys)
protected ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordIterator(org.apache.avro.Schema schema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	getRecordIterator(org.apache.avro.Schema readerSchema)
ClosableIterator<String>	getRecordKeyIterator()
org.apache.avro.Schema	getSchema()
long	getTotalRecords()
BloomFilter	readBloomFilter()
String[]	readMinMaxRecordKeys()

Methods inherited from class org.apache.hudi.io.storage.HoodieAvroFileReader

getRecordIterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.io.storage.HoodieFileReader

getRecordIterator

Constructor Detail

HoodieAvroParquetReader

public HoodieAvroParquetReader(HoodieStorage storage,
                               StoragePath path)

Method Detail

getRecordIterator

public ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> getRecordIterator(org.apache.avro.Schema readerSchema)
                                                                                        throws IOException

Throws:

IOException

readMinMaxRecordKeys

public String[] readMinMaxRecordKeys()

readBloomFilter

public BloomFilter readBloomFilter()

filterRowKeys

public Set<String> filterRowKeys(Set<String> candidateRowKeys)

getIndexedRecordIterator

protected ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordIterator(org.apache.avro.Schema schema)
                                                                                    throws IOException

Overrides:

getIndexedRecordIterator in class HoodieAvroFileReader

Throws:

IOException

getIndexedRecordIterator

public ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordIterator(org.apache.avro.Schema readerSchema,
                                                                                        org.apache.avro.Schema requestedSchema)
                                                                                 throws IOException

Specified by:

getIndexedRecordIterator in class HoodieAvroFileReader

Throws:

IOException

getSchema

public org.apache.avro.Schema getSchema()

close

public void close()

getTotalRecords

public long getTotalRecords()

getRecordKeyIterator

public ClosableIterator<String> getRecordKeyIterator()
                                              throws IOException

Throws:

IOException