org.apache.hudi.common.model

Interface HoodieRecordMerger

All Superinterfaces:

Serializable

All Known Implementing Classes:

HoodieAvroRecordMerger, HoodiePreCombineAvroRecordMerger

@PublicAPIClass(maturity=EVOLVING)
public interface HoodieRecordMerger
extends Serializable

HoodieMerge defines how to merge two records. It is a stateless component. It can implement the merging logic of HoodieRecord of different engines and avoid the performance consumption caused by the serialization/deserialization of Avro payload.

Field Summary

Fields

Modifier and Type	Field and Description
static String	DEFAULT_MERGER_STRATEGY_UUID

Method Summary

Modifier and Type	Method and Description
String	getMergingStrategy() The kind of merging strategy this recordMerger belongs to.
HoodieRecord.HoodieRecordType	getRecordType() The record type handled by the current merger.
Option<Pair<HoodieRecord,org.apache.avro.Schema>>	merge(HoodieRecord older, org.apache.avro.Schema oldSchema, HoodieRecord newer, org.apache.avro.Schema newSchema, TypedProperties props) This method converges combineAndGetUpdateValue and precombine from HoodiePayload.

Field Detail

DEFAULT_MERGER_STRATEGY_UUID

static final String DEFAULT_MERGER_STRATEGY_UUID

See Also:

Constant Field Values

Method Detail

merge

Option<Pair<HoodieRecord,org.apache.avro.Schema>> merge(HoodieRecord older,
                                                        org.apache.avro.Schema oldSchema,
                                                        HoodieRecord newer,
                                                        org.apache.avro.Schema newSchema,
                                                        TypedProperties props)
                                                 throws IOException

This method converges combineAndGetUpdateValue and precombine from HoodiePayload. It'd be associative operation: f(a, f(b, c)) = f(f(a, b), c) (which we can translate as having 3 versions A, B, C of the single record, both orders of operations applications have to yield the same result)

Throws:

IOException

getRecordType

HoodieRecord.HoodieRecordType getRecordType()

The record type handled by the current merger. SPARK, AVRO, FLINK

getMergingStrategy

String getMergingStrategy()

The kind of merging strategy this recordMerger belongs to. An UUID represents merging strategy.