org.apache.hudi.common.model

Class FirstValueAvroPayload

java.lang.Object

org.apache.hudi.common.model.BaseAvroPayload

org.apache.hudi.common.model.OverwriteWithLatestAvroPayload

org.apache.hudi.common.model.DefaultHoodieRecordPayload

org.apache.hudi.common.model.FirstValueAvroPayload

All Implemented Interfaces:

Serializable, HoodieRecordPayload<OverwriteWithLatestAvroPayload>

public class FirstValueAvroPayload
extends DefaultHoodieRecordPayload

Payload clazz that is used for Hudi Table.

Simplified FirstValueAvroPayload Logic:

  Illustration with simple data.
  the order field is 'ts', recordkey is 'id' and schema is :
  {
    [
      {"name":"id","type":"string"},
      {"name":"ts","type":"long"},
      {"name":"name","type":"string"},
      {"name":"price","type":"string"}
    ]
  }

  case 1
  Current data:
      id      ts      name    price
      1       1       name_1  price_1
  Insert data:
      id      ts      name    price
      1       1       name_2  price_2

  Result data after #preCombine or #combineAndGetUpdateValue:
      id      ts      name    price
      1       1       name_1  price_1

  If precombine is the same, would keep the first one record

  case 2
  Current data:
      id      ts      name    price
      1       1       name_1  price_1
  Insert data:
      id      ts      name    price
      1       2       name_2  price_2

  Result data after preCombine or combineAndGetUpdateValue:
      id      ts      name    price
      1       2       name_2  price_2

  The other functionalities are inherited from DefaultHoodieRecordPayload.
 

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.common.model.DefaultHoodieRecordPayload

DELETE_KEY, DELETE_MARKER, METADATA_EVENT_TIME_KEY

Fields inherited from class org.apache.hudi.common.model.BaseAvroPayload

isDeletedRecord, orderingVal, recordBytes

Constructor Summary

Constructors

Constructor and Description
FirstValueAvroPayload(org.apache.avro.generic.GenericRecord record, Comparable orderingVal)
FirstValueAvroPayload(Option<org.apache.avro.generic.GenericRecord> record)

Method Summary

Modifier and Type	Method and Description
protected boolean	needUpdatingPersistedRecord(org.apache.avro.generic.IndexedRecord currentValue, org.apache.avro.generic.IndexedRecord incomingRecord, Properties properties)
OverwriteWithLatestAvroPayload	preCombine(OverwriteWithLatestAvroPayload oldValue) This method is deprecated.

Methods inherited from class org.apache.hudi.common.model.DefaultHoodieRecordPayload

combineAndGetUpdateValue, getInsertValue, getMetadata, isDeleted, isDeleteRecord

Methods inherited from class org.apache.hudi.common.model.OverwriteWithLatestAvroPayload

combineAndGetUpdateValue, getInsertValue, getOrderingValue, overwriteField

Methods inherited from class org.apache.hudi.common.model.BaseAvroPayload

canProduceSentinel, getOrderingVal, isDeleteRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.common.model.HoodieRecordPayload

preCombine, preCombine

Constructor Detail

FirstValueAvroPayload

public FirstValueAvroPayload(org.apache.avro.generic.GenericRecord record,
                             Comparable orderingVal)

FirstValueAvroPayload

public FirstValueAvroPayload(Option<org.apache.avro.generic.GenericRecord> record)

Method Detail

preCombine

public OverwriteWithLatestAvroPayload preCombine(OverwriteWithLatestAvroPayload oldValue)

Description copied from interface: HoodieRecordPayload

This method is deprecated. Please use this HoodieRecordPayload.preCombine(HoodieRecordPayload, Properties) method.

Specified by:

preCombine in interface HoodieRecordPayload<OverwriteWithLatestAvroPayload>

Overrides:

preCombine in class OverwriteWithLatestAvroPayload

needUpdatingPersistedRecord

protected boolean needUpdatingPersistedRecord(org.apache.avro.generic.IndexedRecord currentValue,
                                              org.apache.avro.generic.IndexedRecord incomingRecord,
                                              Properties properties)

Overrides:

needUpdatingPersistedRecord in class DefaultHoodieRecordPayload