org.apache.hudi.common.model

Class HoodiePreCombineAvroRecordMerger

java.lang.Object

org.apache.hudi.common.model.HoodieAvroRecordMerger

org.apache.hudi.common.model.HoodiePreCombineAvroRecordMerger

All Implemented Interfaces:

Serializable, HoodieRecordMerger, OperationModeAwareness

public class HoodiePreCombineAvroRecordMerger
extends HoodieAvroRecordMerger

Record merger for Hoodie avro record.

It should only be used for deduplication among incoming records.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static HoodiePreCombineAvroRecordMerger	INSTANCE

Fields inherited from interface org.apache.hudi.common.model.HoodieRecordMerger

DEFAULT_MERGER_STRATEGY_UUID

Constructor Summary

Constructors

Constructor and Description
HoodiePreCombineAvroRecordMerger()

Method Summary

Modifier and Type	Method and Description
Option<Pair<HoodieRecord,org.apache.avro.Schema>>	merge(HoodieRecord older, org.apache.avro.Schema oldSchema, HoodieRecord newer, org.apache.avro.Schema newSchema, TypedProperties props) This method converges combineAndGetUpdateValue and precombine from HoodiePayload.

Methods inherited from class org.apache.hudi.common.model.HoodieAvroRecordMerger

asPreCombiningMode, getMergingStrategy, getRecordType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INSTANCE

public static final HoodiePreCombineAvroRecordMerger INSTANCE

Constructor Detail

HoodiePreCombineAvroRecordMerger

public HoodiePreCombineAvroRecordMerger()

Method Detail

merge

public Option<Pair<HoodieRecord,org.apache.avro.Schema>> merge(HoodieRecord older,
                                                               org.apache.avro.Schema oldSchema,
                                                               HoodieRecord newer,
                                                               org.apache.avro.Schema newSchema,
                                                               TypedProperties props)
                                                        throws IOException

Description copied from interface: HoodieRecordMerger

This method converges combineAndGetUpdateValue and precombine from HoodiePayload. It'd be associative operation: f(a, f(b, c)) = f(f(a, b), c) (which we can translate as having 3 versions A, B, C of the single record, both orders of operations applications have to yield the same result)

Specified by:

merge in interface HoodieRecordMerger

Overrides:

merge in class HoodieAvroRecordMerger

Throws:

IOException