org.apache.hudi.common.model

Class HoodieAvroRecordMerger

java.lang.Object

org.apache.hudi.common.model.HoodieAvroRecordMerger

All Implemented Interfaces:

Serializable, HoodieRecordMerger, OperationModeAwareness

Direct Known Subclasses:

HoodiePreCombineAvroRecordMerger

public class HoodieAvroRecordMerger
extends Object
implements HoodieRecordMerger, OperationModeAwareness

Record merger for Hoodie avro record.

It should only be used for base record from disk to merge with incoming record.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static HoodieAvroRecordMerger	INSTANCE

Fields inherited from interface org.apache.hudi.common.model.HoodieRecordMerger

DEFAULT_MERGER_STRATEGY_UUID

Constructor Summary

Constructors

Constructor and Description
HoodieAvroRecordMerger()

Method Summary

Modifier and Type	Method and Description
HoodieRecordMerger	asPreCombiningMode() Specifies the legacy operation mode as preCombining.
String	getMergingStrategy() The kind of merging strategy this recordMerger belongs to.
HoodieRecord.HoodieRecordType	getRecordType() The record type handled by the current merger.
Option<Pair<HoodieRecord,org.apache.avro.Schema>>	merge(HoodieRecord older, org.apache.avro.Schema oldSchema, HoodieRecord newer, org.apache.avro.Schema newSchema, TypedProperties props) This method converges combineAndGetUpdateValue and precombine from HoodiePayload.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INSTANCE

public static final HoodieAvroRecordMerger INSTANCE

Constructor Detail

HoodieAvroRecordMerger

public HoodieAvroRecordMerger()

Method Detail

getMergingStrategy

public String getMergingStrategy()

Description copied from interface: HoodieRecordMerger

The kind of merging strategy this recordMerger belongs to. An UUID represents merging strategy.

Specified by:

getMergingStrategy in interface HoodieRecordMerger

merge

public Option<Pair<HoodieRecord,org.apache.avro.Schema>> merge(HoodieRecord older,
                                                               org.apache.avro.Schema oldSchema,
                                                               HoodieRecord newer,
                                                               org.apache.avro.Schema newSchema,
                                                               TypedProperties props)
                                                        throws IOException

Description copied from interface: HoodieRecordMerger

This method converges combineAndGetUpdateValue and precombine from HoodiePayload. It'd be associative operation: f(a, f(b, c)) = f(f(a, b), c) (which we can translate as having 3 versions A, B, C of the single record, both orders of operations applications have to yield the same result)

Specified by:

merge in interface HoodieRecordMerger

Throws:

IOException

getRecordType

public HoodieRecord.HoodieRecordType getRecordType()

Description copied from interface: HoodieRecordMerger

The record type handled by the current merger. SPARK, AVRO, FLINK

Specified by:

getRecordType in interface HoodieRecordMerger

asPreCombiningMode

public HoodieRecordMerger asPreCombiningMode()

Description copied from interface: OperationModeAwareness

Specifies the legacy operation mode as preCombining.

The preCombining takes place in two cases: i). In memory records merging during data ingestion; ii). Log records merging for MOR reader.

Specified by:

asPreCombiningMode in interface OperationModeAwareness