org.apache.hudi.internal

Class HoodieBulkInsertDataInternalWriter

java.lang.Object

org.apache.hudi.internal.HoodieBulkInsertDataInternalWriter

All Implemented Interfaces:

org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

public class HoodieBulkInsertDataInternalWriter
extends Object
implements org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Hoodie's Implementation of DataWriter. This is used in data source implementation for bulk insert.

Constructor Summary

Constructors

Constructor and Description
HoodieBulkInsertDataInternalWriter(HoodieTable hoodieTable, HoodieWriteConfig writeConfig, String instantTime, int taskPartitionId, long taskId, long taskEpochId, org.apache.spark.sql.types.StructType structType, boolean populateMetaFields, boolean arePartitionRecordsSorted)

Method Summary

Modifier and Type	Method and Description
void	abort()
org.apache.spark.sql.sources.v2.writer.WriterCommitMessage	commit()
void	write(org.apache.spark.sql.catalyst.InternalRow record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieBulkInsertDataInternalWriter

public HoodieBulkInsertDataInternalWriter(HoodieTable hoodieTable,
                                          HoodieWriteConfig writeConfig,
                                          String instantTime,
                                          int taskPartitionId,
                                          long taskId,
                                          long taskEpochId,
                                          org.apache.spark.sql.types.StructType structType,
                                          boolean populateMetaFields,
                                          boolean arePartitionRecordsSorted)

Method Detail

write

public void write(org.apache.spark.sql.catalyst.InternalRow record)
           throws IOException

Specified by:

write in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

commit

public org.apache.spark.sql.sources.v2.writer.WriterCommitMessage commit()
                                                                  throws IOException

Specified by:

commit in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

abort

public void abort()

Specified by:

abort in interface org.apache.spark.sql.sources.v2.writer.DataWriter<org.apache.spark.sql.catalyst.InternalRow>