org.apache.hudi.common.table.log.block

Class HoodieHFileDataBlock

java.lang.Object

org.apache.hudi.common.table.log.block.HoodieLogBlock

org.apache.hudi.common.table.log.block.HoodieDataBlock

org.apache.hudi.common.table.log.block.HoodieHFileDataBlock

public class HoodieHFileDataBlock
extends HoodieDataBlock

HoodieHFileDataBlock contains a list of records stored inside an HFile format. It is used with the HFile base file format.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

HoodieLogBlock.FooterMetadataType, HoodieLogBlock.HeaderMetadataType, HoodieLogBlock.HoodieLogBlockContentLocation, HoodieLogBlock.HoodieLogBlockType

Field Summary

Fields inherited from class org.apache.hudi.common.table.log.block.HoodieDataBlock

internalSchema, readerSchema

Fields inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

readBlockLazily, version

Constructor Summary

Constructors

Constructor and Description
HoodieHFileDataBlock(org.apache.hadoop.fs.FSDataInputStream inputStream, Option<byte[]> content, boolean readBlockLazily, HoodieLogBlock.HoodieLogBlockContentLocation logBlockContentLocation, Option<org.apache.avro.Schema> readerSchema, Map<HoodieLogBlock.HeaderMetadataType,String> header, Map<HoodieLogBlock.HeaderMetadataType,String> footer, boolean enablePointLookups, org.apache.hadoop.fs.Path pathForReader)
HoodieHFileDataBlock(List<org.apache.avro.generic.IndexedRecord> records, Map<HoodieLogBlock.HeaderMetadataType,String> header, org.apache.hadoop.hbase.io.compress.Compression.Algorithm compressionAlgorithm, org.apache.hadoop.fs.Path pathForReader)

Method Summary

Modifier and Type	Method and Description
protected ClosableIterator<org.apache.avro.generic.IndexedRecord>	deserializeRecords(byte[] content)
HoodieLogBlock.HoodieLogBlockType	getBlockType()
protected ClosableIterator<org.apache.avro.generic.IndexedRecord>	lookupRecords(List<String> keys, boolean fullKey)
protected byte[]	serializeRecords(List<org.apache.avro.generic.IndexedRecord> records)

Methods inherited from class org.apache.hudi.common.table.log.block.HoodieDataBlock

getContentBytes, getKeyField, getRecordIterator, getRecordIterator, getRecordKey, getSchema, getWriterSchema, readRecordsFromBlockPayload

Methods inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

deflate, getBlockContentLocation, getContent, getLogBlockFooter, getLogBlockHeader, getLogBlockLength, getLogMetadata, getLogMetadataBytes, getMagic, inflate, tryReadContent

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieHFileDataBlock

public HoodieHFileDataBlock(org.apache.hadoop.fs.FSDataInputStream inputStream,
                            Option<byte[]> content,
                            boolean readBlockLazily,
                            HoodieLogBlock.HoodieLogBlockContentLocation logBlockContentLocation,
                            Option<org.apache.avro.Schema> readerSchema,
                            Map<HoodieLogBlock.HeaderMetadataType,String> header,
                            Map<HoodieLogBlock.HeaderMetadataType,String> footer,
                            boolean enablePointLookups,
                            org.apache.hadoop.fs.Path pathForReader)

HoodieHFileDataBlock

public HoodieHFileDataBlock(List<org.apache.avro.generic.IndexedRecord> records,
                            Map<HoodieLogBlock.HeaderMetadataType,String> header,
                            org.apache.hadoop.hbase.io.compress.Compression.Algorithm compressionAlgorithm,
                            org.apache.hadoop.fs.Path pathForReader)

Method Detail

getBlockType

public HoodieLogBlock.HoodieLogBlockType getBlockType()

Specified by:

getBlockType in class HoodieDataBlock

serializeRecords

protected byte[] serializeRecords(List<org.apache.avro.generic.IndexedRecord> records)
                           throws IOException

Specified by:

serializeRecords in class HoodieDataBlock

Throws:

IOException

deserializeRecords

protected ClosableIterator<org.apache.avro.generic.IndexedRecord> deserializeRecords(byte[] content)
                                                                              throws IOException

Specified by:

deserializeRecords in class HoodieDataBlock

Throws:

IOException

lookupRecords

protected ClosableIterator<org.apache.avro.generic.IndexedRecord> lookupRecords(List<String> keys,
                                                                                boolean fullKey)
                                                                         throws IOException

Overrides:

lookupRecords in class HoodieDataBlock

Throws:

IOException