org.apache.hudi.table.action.commit

Class BaseMergeHelper<T extends HoodieRecordPayload,I,K,O>

java.lang.Object

org.apache.hudi.table.action.commit.BaseMergeHelper<T,I,K,O>

Direct Known Subclasses:

HoodieMergeHelper

public abstract class BaseMergeHelper<T extends HoodieRecordPayload,I,K,O>
extends Object

Helper to read records from previous version of base file and run Merge.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	BaseMergeHelper.UpdateHandler Consumer that dequeues records from queue and sends to Merge Handle.

Constructor Summary

Constructors

Constructor and Description
BaseMergeHelper()

Method Summary

Modifier and Type	Method and Description
abstract void	runMerge(HoodieTable<T,I,K,O> table, HoodieMergeHandle<T,I,K,O> upsertHandle) Read records from previous version of base file and merge.
protected org.apache.avro.generic.GenericRecord	transformRecordBasedOnNewSchema(org.apache.avro.generic.GenericDatumReader<org.apache.avro.generic.GenericRecord> gReader, org.apache.avro.generic.GenericDatumWriter<org.apache.avro.generic.GenericRecord> gWriter, ThreadLocal<org.apache.avro.io.BinaryEncoder> encoderCache, ThreadLocal<org.apache.avro.io.BinaryDecoder> decoderCache, org.apache.avro.generic.GenericRecord gRec)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseMergeHelper

public BaseMergeHelper()

Method Detail

runMerge

public abstract void runMerge(HoodieTable<T,I,K,O> table,
                              HoodieMergeHandle<T,I,K,O> upsertHandle)
                       throws IOException

Read records from previous version of base file and merge.

Parameters:

table - Hoodie Table

upsertHandle - Merge Handle

Throws:

IOException - in case of error

transformRecordBasedOnNewSchema

protected org.apache.avro.generic.GenericRecord transformRecordBasedOnNewSchema(org.apache.avro.generic.GenericDatumReader<org.apache.avro.generic.GenericRecord> gReader,
                                                                                org.apache.avro.generic.GenericDatumWriter<org.apache.avro.generic.GenericRecord> gWriter,
                                                                                ThreadLocal<org.apache.avro.io.BinaryEncoder> encoderCache,
                                                                                ThreadLocal<org.apache.avro.io.BinaryDecoder> decoderCache,
                                                                                org.apache.avro.generic.GenericRecord gRec)