org.apache.hudi.common.table.log.block

Class HoodieHFileDataBlock

java.lang.Object

org.apache.hudi.common.table.log.block.HoodieLogBlock

org.apache.hudi.common.table.log.block.HoodieDataBlock

org.apache.hudi.common.table.log.block.HoodieHFileDataBlock

public class HoodieHFileDataBlock
extends HoodieDataBlock

HoodieHFileDataBlock contains a list of records stored inside an HFile format. It is used with the HFile base file format.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

HoodieLogBlock.FooterMetadataType, HoodieLogBlock.HeaderMetadataType, HoodieLogBlock.HoodieLogBlockContentLocation, HoodieLogBlock.HoodieLogBlockType

Field Summary

Fields inherited from class org.apache.hudi.common.table.log.block.HoodieDataBlock

readerSchema

Fields inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

readBlockLazily, version

Constructor Summary

Constructors

Constructor and Description
HoodieHFileDataBlock(List<HoodieRecord> records, Map<HoodieLogBlock.HeaderMetadataType,String> header, String compressionCodec, StoragePath pathForReader, boolean useNativeHFileReader)
HoodieHFileDataBlock(Supplier<SeekableDataInputStream> inputStreamSupplier, Option<byte[]> content, boolean readBlockLazily, HoodieLogBlock.HoodieLogBlockContentLocation logBlockContentLocation, Option<org.apache.avro.Schema> readerSchema, Map<HoodieLogBlock.HeaderMetadataType,String> header, Map<HoodieLogBlock.HeaderMetadataType,String> footer, boolean enablePointLookups, StoragePath pathForReader, boolean useNativeHFileReader)

Method Summary

Modifier and Type	Method and Description
protected <T> ClosableIterator<HoodieRecord<T>>	deserializeRecords(byte[] content, HoodieRecord.HoodieRecordType type)
HoodieLogBlock.HoodieLogBlockType	getBlockType()
protected <T> ClosableIterator<HoodieRecord<T>>	lookupRecords(List<String> sortedKeys, boolean fullKey)
protected byte[]	serializeRecords(List<HoodieRecord> records, HoodieStorage storage)

Methods inherited from class org.apache.hudi.common.table.log.block.HoodieDataBlock

getContentBytes, getKeyField, getKeyFieldName, getRecordIterator, getRecordIterator, getRecordKey, getSchema, getSchemaFromHeader, getWriterSchema, readRecordsFromBlockPayload

Methods inherited from class org.apache.hudi.common.table.log.block.HoodieLogBlock

deflate, getBlockContentLocation, getContent, getLogBlockFooter, getLogBlockHeader, getLogBlockLength, getLogMetadata, getLogMetadataBytes, getMagic, getRecordPositions, inflate, isCompactedLogBlock, tryReadContent

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieHFileDataBlock

public HoodieHFileDataBlock(Supplier<SeekableDataInputStream> inputStreamSupplier,
                            Option<byte[]> content,
                            boolean readBlockLazily,
                            HoodieLogBlock.HoodieLogBlockContentLocation logBlockContentLocation,
                            Option<org.apache.avro.Schema> readerSchema,
                            Map<HoodieLogBlock.HeaderMetadataType,String> header,
                            Map<HoodieLogBlock.HeaderMetadataType,String> footer,
                            boolean enablePointLookups,
                            StoragePath pathForReader,
                            boolean useNativeHFileReader)

HoodieHFileDataBlock

public HoodieHFileDataBlock(List<HoodieRecord> records,
                            Map<HoodieLogBlock.HeaderMetadataType,String> header,
                            String compressionCodec,
                            StoragePath pathForReader,
                            boolean useNativeHFileReader)

Method Detail

getBlockType

public HoodieLogBlock.HoodieLogBlockType getBlockType()

Specified by:

getBlockType in class HoodieDataBlock

serializeRecords

protected byte[] serializeRecords(List<HoodieRecord> records,
                                  HoodieStorage storage)
                           throws IOException

Specified by:

serializeRecords in class HoodieDataBlock

Throws:

IOException

deserializeRecords

protected <T> ClosableIterator<HoodieRecord<T>> deserializeRecords(byte[] content,
                                                                   HoodieRecord.HoodieRecordType type)
                                                            throws IOException

Specified by:

deserializeRecords in class HoodieDataBlock

Throws:

IOException

lookupRecords

protected <T> ClosableIterator<HoodieRecord<T>> lookupRecords(List<String> sortedKeys,
                                                              boolean fullKey)
                                                       throws IOException

Overrides:

lookupRecords in class HoodieDataBlock

Throws:

IOException