public class HoodieAvroHFileWriter extends Object implements HoodieAvroFileWriter
Limitations (compared to columnar formats like Parquet or ORC): 1. Records should be added in order of keys 2. There are no column stats
| Constructor and Description |
|---|
HoodieAvroHFileWriter(String instantTime,
StoragePath file,
HoodieHFileConfig hfileConfig,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier,
boolean populateMetaFields) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
canWrite() |
void |
close() |
void |
writeAvro(String recordKey,
org.apache.avro.generic.IndexedRecord record) |
void |
writeAvroWithMetadata(HoodieKey key,
org.apache.avro.generic.IndexedRecord avroRecord) |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitprepRecordWithMetadata, write, writeWithMetadatawrite, writeWithMetadatapublic HoodieAvroHFileWriter(String instantTime, StoragePath file, HoodieHFileConfig hfileConfig, org.apache.avro.Schema schema, TaskContextSupplier taskContextSupplier, boolean populateMetaFields) throws IOException
IOExceptionpublic void writeAvroWithMetadata(HoodieKey key, org.apache.avro.generic.IndexedRecord avroRecord) throws IOException
writeAvroWithMetadata in interface HoodieAvroFileWriterIOExceptionpublic boolean canWrite()
canWrite in interface HoodieAvroFileWritercanWrite in interface HoodieFileWriterpublic void writeAvro(String recordKey, org.apache.avro.generic.IndexedRecord record) throws IOException
writeAvro in interface HoodieAvroFileWriterIOExceptionpublic void close()
throws IOException
close in interface HoodieAvroFileWriterclose in interface HoodieFileWriterIOExceptionCopyright © 2024 The Apache Software Foundation. All rights reserved.