org.apache.hudi.internal

Class HoodieBulkInsertDataInternalWriter

java.lang.Object

org.apache.hudi.internal.HoodieBulkInsertDataInternalWriter

All Implemented Interfaces:

org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

public class HoodieBulkInsertDataInternalWriter
extends Object
implements org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Hoodie's Implementation of DataWriter. This is used in data source implementation for bulk insert.

Constructor Summary

Constructors

Constructor and Description
HoodieBulkInsertDataInternalWriter(org.apache.hudi.table.HoodieTable hoodieTable, org.apache.hudi.config.HoodieWriteConfig writeConfig, String instantTime, int taskPartitionId, long taskId, long taskEpochId, org.apache.spark.sql.types.StructType structType, boolean populateMetaFields, boolean arePartitionRecordsSorted)

Method Summary

Modifier and Type	Method and Description
void	abort()
org.apache.spark.sql.sources.v2.writer.WriterCommitMessage	commit()
void	write(org.apache.spark.sql.catalyst.InternalRow record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieBulkInsertDataInternalWriter

public HoodieBulkInsertDataInternalWriter(org.apache.hudi.table.HoodieTable hoodieTable,
                                          org.apache.hudi.config.HoodieWriteConfig writeConfig,
                                          String instantTime,
                                          int taskPartitionId,
                                          long taskId,
                                          long taskEpochId,
                                          org.apache.spark.sql.types.StructType structType,
                                          boolean populateMetaFields,
                                          boolean arePartitionRecordsSorted)

Method Detail

write

public void write(org.apache.spark.sql.catalyst.InternalRow record)
           throws IOException

Specified by:

write in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

commit

public org.apache.spark.sql.sources.v2.writer.WriterCommitMessage commit()
                                                                  throws IOException

Specified by:

commit in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

abort

public void abort()

Specified by:

abort in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>