org.apache.hudi.common.model

Class OverwriteNonDefaultsWithLatestAvroPayload

java.lang.Object

org.apache.hudi.common.model.BaseAvroPayload

org.apache.hudi.common.model.OverwriteWithLatestAvroPayload

org.apache.hudi.common.model.OverwriteNonDefaultsWithLatestAvroPayload

All Implemented Interfaces:

Serializable, HoodieRecordPayload<OverwriteWithLatestAvroPayload>

Direct Known Subclasses:

PartialUpdateAvroPayload

public class OverwriteNonDefaultsWithLatestAvroPayload
extends OverwriteWithLatestAvroPayload

subclass of OverwriteWithLatestAvroPayload.

1. preCombine - Picks the latest delta record for a key, based on an ordering field;
2. combineAndGetUpdateValue/getInsertValue - overwrite storage for specified fields that doesn't equal defaultValue.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.common.model.BaseAvroPayload

isDeletedRecord, orderingVal, recordBytes

Constructor Summary

Constructors

Constructor and Description
OverwriteNonDefaultsWithLatestAvroPayload(org.apache.avro.generic.GenericRecord record, Comparable orderingVal)
OverwriteNonDefaultsWithLatestAvroPayload(Option<org.apache.avro.generic.GenericRecord> record)

Method Summary

Modifier and Type	Method and Description
Option<org.apache.avro.generic.IndexedRecord>	combineAndGetUpdateValue(org.apache.avro.generic.IndexedRecord currentValue, org.apache.avro.Schema schema) This methods is deprecated.
protected Option<org.apache.avro.generic.IndexedRecord>	mergeRecords(org.apache.avro.Schema schema, org.apache.avro.generic.GenericRecord baseRecord, org.apache.avro.generic.GenericRecord mergedRecord) Merges the given records into one.
protected void	setField(org.apache.avro.generic.GenericRecord baseRecord, org.apache.avro.generic.GenericRecord mergedRecord, org.apache.avro.generic.GenericRecordBuilder builder, org.apache.avro.Schema.Field field)

Methods inherited from class org.apache.hudi.common.model.OverwriteWithLatestAvroPayload

getInsertValue, getOrderingValue, overwriteField, preCombine

Methods inherited from class org.apache.hudi.common.model.BaseAvroPayload

canProduceSentinel, getOrderingVal, isDeleted, isDeleteRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.common.model.HoodieRecordPayload

combineAndGetUpdateValue, getInsertValue, getMetadata, preCombine, preCombine

Constructor Detail

OverwriteNonDefaultsWithLatestAvroPayload

public OverwriteNonDefaultsWithLatestAvroPayload(org.apache.avro.generic.GenericRecord record,
                                                 Comparable orderingVal)

OverwriteNonDefaultsWithLatestAvroPayload

public OverwriteNonDefaultsWithLatestAvroPayload(Option<org.apache.avro.generic.GenericRecord> record)

Method Detail

combineAndGetUpdateValue

public Option<org.apache.avro.generic.IndexedRecord> combineAndGetUpdateValue(org.apache.avro.generic.IndexedRecord currentValue,
                                                                              org.apache.avro.Schema schema)
                                                                       throws IOException

Description copied from interface: HoodieRecordPayload

This methods is deprecated. Please refer to HoodieRecordPayload.combineAndGetUpdateValue(IndexedRecord, Schema, Properties) for java docs.

Specified by:

combineAndGetUpdateValue in interface HoodieRecordPayload<OverwriteWithLatestAvroPayload>

Overrides:

combineAndGetUpdateValue in class OverwriteWithLatestAvroPayload

Throws:

IOException

mergeRecords

protected Option<org.apache.avro.generic.IndexedRecord> mergeRecords(org.apache.avro.Schema schema,
                                                                     org.apache.avro.generic.GenericRecord baseRecord,
                                                                     org.apache.avro.generic.GenericRecord mergedRecord)

Merges the given records into one. The fields in baseRecord has higher priority: it is set up into the merged record if it is not null or equals to the default.

Parameters:

schema - The record schema

baseRecord - The base record to merge with

mergedRecord - The record to be merged

Returns:

the merged record option

setField

protected void setField(org.apache.avro.generic.GenericRecord baseRecord,
                        org.apache.avro.generic.GenericRecord mergedRecord,
                        org.apache.avro.generic.GenericRecordBuilder builder,
                        org.apache.avro.Schema.Field field)