org.apache.hudi.io.hadoop

Class HoodieParquetStreamWriter

java.lang.Object

org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

All Implemented Interfaces:

AutoCloseable, HoodieAvroFileWriter, HoodieFileWriter

public class HoodieParquetStreamWriter
extends Object
implements HoodieAvroFileWriter, AutoCloseable

Hudi log block writer for parquet format.

TODO(HUDI-3035) unify w/ HoodieParquetWriter.

Constructor Summary

Constructors

Constructor and Description
HoodieParquetStreamWriter(org.apache.hadoop.fs.FSDataOutputStream outputStream, HoodieParquetConfig<HoodieAvroWriteSupport> parquetConfig)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite()
void	close()
void	writeAvro(String key, org.apache.avro.generic.IndexedRecord record)
void	writeAvroWithMetadata(HoodieKey key, org.apache.avro.generic.IndexedRecord avroRecord)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.io.storage.HoodieAvroFileWriter

prepRecordWithMetadata, write, writeWithMetadata

Methods inherited from interface org.apache.hudi.io.storage.HoodieFileWriter

write, writeWithMetadata

Constructor Detail

HoodieParquetStreamWriter

public HoodieParquetStreamWriter(org.apache.hadoop.fs.FSDataOutputStream outputStream,
                                 HoodieParquetConfig<HoodieAvroWriteSupport> parquetConfig)
                          throws IOException

Throws:

IOException

Method Detail

canWrite

public boolean canWrite()

Specified by:

canWrite in interface HoodieAvroFileWriter

Specified by:

canWrite in interface HoodieFileWriter

writeAvro

public void writeAvro(String key,
                      org.apache.avro.generic.IndexedRecord record)
               throws IOException

Specified by:

writeAvro in interface HoodieAvroFileWriter

Throws:

IOException

writeAvroWithMetadata

public void writeAvroWithMetadata(HoodieKey key,
                                  org.apache.avro.generic.IndexedRecord avroRecord)
                           throws IOException

Specified by:

writeAvroWithMetadata in interface HoodieAvroFileWriter

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface HoodieAvroFileWriter

Specified by:

close in interface HoodieFileWriter

Throws:

IOException