| Package | Description |
|---|---|
| org.apache.hudi.common.table.log.block | |
| org.apache.hudi.common.util | |
| org.apache.hudi.common.util.collection | |
| org.apache.hudi.io.storage |
| Modifier and Type | Method and Description |
|---|---|
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieParquetDataBlock.deserializeRecords(byte[] content) |
protected abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieDataBlock.deserializeRecords(byte[] content) |
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieHFileDataBlock.deserializeRecords(byte[] content) |
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieAvroDataBlock.deserializeRecords(byte[] content) |
static ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieParquetDataBlock.getProjectedParquetRecordsIterator(org.apache.hadoop.conf.Configuration conf,
org.apache.avro.Schema readerSchema,
org.apache.parquet.io.InputFile inputFile) |
ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieDataBlock.getRecordIterator()
Returns all the records iterator contained w/in this block.
|
ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieDataBlock.getRecordIterator(List<String> keys,
boolean fullKey)
Batch get of keys of interest.
|
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieDataBlock.lookupRecords(List<String> keys,
boolean fullKey) |
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieHFileDataBlock.lookupRecords(List<String> keys,
boolean fullKey) |
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieParquetDataBlock.readRecordsFromBlockPayload()
NOTE: We're overriding the whole reading sequence to make sure we properly respect
the requested Reader's schema and only fetch the columns that have been explicitly
requested by the caller (providing projected Reader's schema)
|
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieDataBlock.readRecordsFromBlockPayload() |
| Modifier and Type | Class and Description |
|---|---|
class |
OrcReaderIterator<T>
This class wraps a ORC reader and provides an iterator based api to read from an ORC file.
|
class |
ParquetReaderIterator<T>
This class wraps a parquet reader and provides an iterator based api to read from a parquet file.
|
| Modifier and Type | Method and Description |
|---|---|
abstract ClosableIterator<HoodieKey> |
BaseFileUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath)
Provides a closable iterator for reading the given data file.
|
ClosableIterator<HoodieKey> |
ParquetUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath) |
ClosableIterator<HoodieKey> |
OrcUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath)
Provides a closable iterator for reading the given ORC file.
|
abstract ClosableIterator<HoodieKey> |
BaseFileUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath,
Option<BaseKeyGenerator> keyGeneratorOpt)
Provides a closable iterator for reading the given data file.
|
ClosableIterator<HoodieKey> |
ParquetUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath,
Option<BaseKeyGenerator> keyGeneratorOpt)
Returns a closable iterator for reading the given parquet file.
|
ClosableIterator<HoodieKey> |
OrcUtils.getHoodieKeyIterator(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path filePath,
Option<BaseKeyGenerator> keyGeneratorOpt) |
| Modifier and Type | Class and Description |
|---|---|
class |
LazyFileIterable.LazyFileIterator<T,R>
Iterator implementation for the iterable defined above.
|
| Modifier and Type | Method and Description |
|---|---|
ClosableIterator<R> |
LazyFileIterable.iterator() |
| Modifier and Type | Method and Description |
|---|---|
default ClosableIterator<R> |
HoodieFileReader.getRecordIterator() |
ClosableIterator<R> |
HoodieOrcReader.getRecordIterator(org.apache.avro.Schema schema) |
ClosableIterator<R> |
HoodieParquetReader.getRecordIterator(org.apache.avro.Schema schema) |
ClosableIterator<R> |
HoodieHFileReader.getRecordIterator(org.apache.avro.Schema readerSchema) |
ClosableIterator<R> |
HoodieFileReader.getRecordIterator(org.apache.avro.Schema readerSchema) |
default ClosableIterator<R> |
HoodieFileReader.getRecordsByKeyPrefixIterator(List<String> keyPrefixes) |
ClosableIterator<R> |
HoodieHFileReader.getRecordsByKeyPrefixIterator(List<String> keyPrefixes,
org.apache.avro.Schema readerSchema) |
default ClosableIterator<R> |
HoodieFileReader.getRecordsByKeyPrefixIterator(List<String> keyPrefixes,
org.apache.avro.Schema schema) |
default ClosableIterator<R> |
HoodieFileReader.getRecordsByKeysIterator(List<String> keys) |
ClosableIterator<R> |
HoodieHFileReader.getRecordsByKeysIterator(List<String> keys,
org.apache.avro.Schema readerSchema) |
default ClosableIterator<R> |
HoodieFileReader.getRecordsByKeysIterator(List<String> keys,
org.apache.avro.Schema schema) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.