org.apache.hudi.integ.testsuite.writer

Class AvroFileDeltaInputWriter

java.lang.Object

org.apache.hudi.integ.testsuite.writer.AvroFileDeltaInputWriter

All Implemented Interfaces:

Closeable, AutoCloseable, DeltaInputWriter<org.apache.avro.generic.GenericRecord>

public class AvroFileDeltaInputWriter
extends Object
implements DeltaInputWriter<org.apache.avro.generic.GenericRecord>

Implementation of DeltaInputWriter that writes avro records to the result file.

Field Summary

Fields

Modifier and Type	Field and Description
static String	AVRO_EXTENSION

Constructor Summary

Constructors

Constructor and Description
AvroFileDeltaInputWriter(org.apache.hadoop.conf.Configuration configuration, String basePath, String schemaStr, Long maxFileSize)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite() Check whether more data can/should be written.
void	close()
DeltaWriteStats	getDeltaWriteStats() Return the statistics of data written.
org.apache.hadoop.fs.FileSystem	getFs()
DeltaInputWriter	getNewWriter() Return a new instance of this writer.
org.apache.hadoop.fs.Path	getPath()
void	writeData(org.apache.avro.generic.GenericRecord iData) Generate any type of data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

AVRO_EXTENSION

public static final String AVRO_EXTENSION

See Also:

Constant Field Values

Constructor Detail

AvroFileDeltaInputWriter

public AvroFileDeltaInputWriter(org.apache.hadoop.conf.Configuration configuration,
                                String basePath,
                                String schemaStr,
                                Long maxFileSize)
                         throws IOException

Throws:

IOException

Method Detail

writeData

public void writeData(org.apache.avro.generic.GenericRecord iData)
               throws IOException

Description copied from interface: DeltaInputWriter

Generate any type of data.

Specified by:

writeData in interface DeltaInputWriter<org.apache.avro.generic.GenericRecord>

Throws:

IOException

canWrite

public boolean canWrite()

Description copied from interface: DeltaInputWriter

Check whether more data can/should be written.

Specified by:

canWrite in interface DeltaInputWriter<org.apache.avro.generic.GenericRecord>

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

getNewWriter

public DeltaInputWriter getNewWriter()
                              throws IOException

Description copied from interface: DeltaInputWriter

Return a new instance of this writer.

Specified by:

getNewWriter in interface DeltaInputWriter<org.apache.avro.generic.GenericRecord>

Returns:

Throws:

IOException

getFs

public org.apache.hadoop.fs.FileSystem getFs()

getPath

public org.apache.hadoop.fs.Path getPath()

getDeltaWriteStats

public DeltaWriteStats getDeltaWriteStats()

Description copied from interface: DeltaInputWriter

Return the statistics of data written.

Specified by:

getDeltaWriteStats in interface DeltaInputWriter<org.apache.avro.generic.GenericRecord>