org.apache.hudi.io

Class HoodieBootstrapHandle<T,I,K,O>

java.lang.Object

org.apache.hudi.io.HoodieIOHandle<T,I,K,O>

org.apache.hudi.io.HoodieWriteHandle<T,I,K,O>

org.apache.hudi.io.HoodieCreateHandle<T,I,K,O>

org.apache.hudi.io.HoodieBootstrapHandle<T,I,K,O>

Type Parameters:

T - HoodieRecordPayload

public class HoodieBootstrapHandle<T,I,K,O>
extends HoodieCreateHandle<T,I,K,O>

This class is essentially same as Create Handle but overrides two things 1) Schema : Metadata bootstrap writes only metadata fields as part of write. So, setup the writer schema accordingly. 2) canWrite is overridden to always return true so that skeleton file and bootstrap file is aligned and we don't end up writing more than 1 skeleton file for the same bootstrap file.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.avro.Schema	METADATA_BOOTSTRAP_RECORD_SCHEMA

Fields inherited from class org.apache.hudi.io.HoodieCreateHandle

fileWriter, insertRecordsWritten, path, recordsDeleted, recordsWritten

Fields inherited from class org.apache.hudi.io.HoodieWriteHandle

fileId, newRecordLocation, partitionPath, recordMerger, schemaOnReadEnabled, taskContextSupplier, timer, writeSchema, writeSchemaWithMetaFields, writeStatus, writeToken

Fields inherited from class org.apache.hudi.io.HoodieIOHandle

config, fs, hoodieTable, instantTime

Constructor Summary

Constructors

Constructor and Description
HoodieBootstrapHandle(HoodieWriteConfig config, String commitTime, HoodieTable<T,I,K,O> hoodieTable, String partitionPath, String fileId, TaskContextSupplier taskContextSupplier)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite(HoodieRecord record) Determines whether we can accept the incoming records, into the current file.

Methods inherited from class org.apache.hudi.io.HoodieCreateHandle

close, doWrite, getIOType, setupWriteStatus, write

Methods inherited from class org.apache.hudi.io.HoodieWriteHandle

createLogWriter, createLogWriter, createLogWriter, createMarkerFile, getAttemptId, getConfig, getFileId, getFileSystem, getHoodieTableMetaClient, getPartitionId, getPartitionPath, getStageId, getWriterSchema, getWriterSchemaWithMetaFields, isClosed, makeNewFilePath, makeNewPath, markClosed, toAvroRecord, write, writeStatuses

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

METADATA_BOOTSTRAP_RECORD_SCHEMA

public static final org.apache.avro.Schema METADATA_BOOTSTRAP_RECORD_SCHEMA

Constructor Detail

HoodieBootstrapHandle

public HoodieBootstrapHandle(HoodieWriteConfig config,
                             String commitTime,
                             HoodieTable<T,I,K,O> hoodieTable,
                             String partitionPath,
                             String fileId,
                             TaskContextSupplier taskContextSupplier)

Method Detail

canWrite

public boolean canWrite(HoodieRecord record)

Description copied from class: HoodieWriteHandle

Determines whether we can accept the incoming records, into the current file. Depending on

- Whether it belongs to the same partitionPath as existing records - Whether the current file written bytes lt max file size

Overrides:

canWrite in class HoodieCreateHandle<T,I,K,O>