org.apache.hudi.io

Class HoodieUnboundedCreateHandle<T,I,K,O>

java.lang.Object

org.apache.hudi.io.HoodieIOHandle<T,I,K,O>

org.apache.hudi.io.HoodieWriteHandle<T,I,K,O>

org.apache.hudi.io.HoodieCreateHandle<T,I,K,O>

org.apache.hudi.io.HoodieUnboundedCreateHandle<T,I,K,O>

@NotThreadSafe
public class HoodieUnboundedCreateHandle<T,I,K,O>
extends HoodieCreateHandle<T,I,K,O>

A HoodieCreateHandle which writes all data into a single file.

Please use this with caution. This can end up creating very large files if not used correctly.

Field Summary

Fields inherited from class org.apache.hudi.io.HoodieCreateHandle

fileWriter, insertRecordsWritten, path, recordsDeleted, recordsWritten

Fields inherited from class org.apache.hudi.io.HoodieWriteHandle

fileId, newRecordLocation, partitionPath, recordMerger, schemaOnReadEnabled, taskContextSupplier, timer, writeSchema, writeSchemaWithMetaFields, writeStatus, writeToken

Fields inherited from class org.apache.hudi.io.HoodieIOHandle

config, fs, hoodieTable, instantTime

Constructor Summary

Constructors

Constructor and Description
HoodieUnboundedCreateHandle(HoodieWriteConfig config, String instantTime, HoodieTable<T,I,K,O> hoodieTable, String partitionPath, String fileId, TaskContextSupplier taskContextSupplier, boolean preserveHoodieMetadata)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite(HoodieRecord record) Determines whether we can accept the incoming records, into the current file.

Methods inherited from class org.apache.hudi.io.HoodieCreateHandle

close, doWrite, getIOType, setupWriteStatus, write

Methods inherited from class org.apache.hudi.io.HoodieWriteHandle

createLogWriter, createLogWriter, createLogWriter, createMarkerFile, getAttemptId, getConfig, getFileId, getFileSystem, getHoodieTableMetaClient, getPartitionId, getPartitionPath, getStageId, getWriterSchema, getWriterSchemaWithMetaFields, isClosed, makeNewFilePath, makeNewPath, markClosed, toAvroRecord, write, writeStatuses

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieUnboundedCreateHandle

public HoodieUnboundedCreateHandle(HoodieWriteConfig config,
                                   String instantTime,
                                   HoodieTable<T,I,K,O> hoodieTable,
                                   String partitionPath,
                                   String fileId,
                                   TaskContextSupplier taskContextSupplier,
                                   boolean preserveHoodieMetadata)

Method Detail

canWrite

public boolean canWrite(HoodieRecord record)

Description copied from class: HoodieWriteHandle

Determines whether we can accept the incoming records, into the current file. Depending on

- Whether it belongs to the same partitionPath as existing records - Whether the current file written bytes lt max file size

Overrides:

canWrite in class HoodieCreateHandle<T,I,K,O>