org.apache.hudi.common.table.cdc

Class HoodieCDCUtils

java.lang.Object

org.apache.hudi.common.table.cdc.HoodieCDCUtils

public class HoodieCDCUtils
extends Object

Utilities for change log capture.

Field Summary

Fields

Modifier and Type	Field and Description
static String	CDC_AFTER_IMAGE
static String	CDC_BEFORE_IMAGE
static String[]	CDC_COLUMNS
static String	CDC_COMMIT_TIMESTAMP
static String	CDC_LOGFILE_SUFFIX
static String	CDC_OPERATION_TYPE
static String	CDC_RECORD_KEY
static org.apache.avro.Schema	CDC_SCHEMA_OP_AND_RECORDKEY
static String	CDC_SCHEMA_OP_AND_RECORDKEY_STRING The schema of cdc log file in the case `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.OP_KEY_ONLY.

Constructor Summary

Constructors

Constructor and Description
HoodieCDCUtils()

Method Summary

Modifier and Type	Method and Description
static org.apache.avro.generic.GenericData.Record	cdcRecord(org.apache.avro.Schema cdcSchema, String op, String recordKey) Build the cdc record when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.OP_KEY_ONLY.
static org.apache.avro.generic.GenericData.Record	cdcRecord(org.apache.avro.Schema cdcSchema, String op, String recordKey, org.apache.avro.generic.GenericRecord before) Build the cdc record when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.DATA_BEFORE.
static org.apache.avro.generic.GenericData.Record	cdcRecord(org.apache.avro.Schema cdcSchema, String op, String commitTime, org.apache.avro.generic.GenericRecord before, org.apache.avro.generic.GenericRecord after) Build the cdc record which has all the cdc fields when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.DATA_BEFORE_AFTER.
static String	recordToJson(org.apache.avro.generic.GenericRecord record)
static org.apache.avro.Schema	schemaBySupplementalLoggingMode(HoodieCDCSupplementalLoggingMode supplementalLoggingMode, org.apache.avro.Schema tableSchema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CDC_LOGFILE_SUFFIX

public static final String CDC_LOGFILE_SUFFIX

See Also:

Constant Field Values

CDC_OPERATION_TYPE

public static final String CDC_OPERATION_TYPE

See Also:

Constant Field Values

CDC_COMMIT_TIMESTAMP

public static final String CDC_COMMIT_TIMESTAMP

See Also:

Constant Field Values

CDC_BEFORE_IMAGE

public static final String CDC_BEFORE_IMAGE

See Also:

Constant Field Values

CDC_AFTER_IMAGE

public static final String CDC_AFTER_IMAGE

See Also:

Constant Field Values

CDC_RECORD_KEY

public static final String CDC_RECORD_KEY

See Also:

Constant Field Values

CDC_COLUMNS

public static final String[] CDC_COLUMNS

CDC_SCHEMA_OP_AND_RECORDKEY_STRING

public static final String CDC_SCHEMA_OP_AND_RECORDKEY_STRING

The schema of cdc log file in the case `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.OP_KEY_ONLY.

See Also:

Constant Field Values

CDC_SCHEMA_OP_AND_RECORDKEY

public static final org.apache.avro.Schema CDC_SCHEMA_OP_AND_RECORDKEY

Constructor Detail

HoodieCDCUtils

public HoodieCDCUtils()

Method Detail

schemaBySupplementalLoggingMode

public static org.apache.avro.Schema schemaBySupplementalLoggingMode(HoodieCDCSupplementalLoggingMode supplementalLoggingMode,
                                                                     org.apache.avro.Schema tableSchema)

cdcRecord

public static org.apache.avro.generic.GenericData.Record cdcRecord(org.apache.avro.Schema cdcSchema,
                                                                   String op,
                                                                   String commitTime,
                                                                   org.apache.avro.generic.GenericRecord before,
                                                                   org.apache.avro.generic.GenericRecord after)

Build the cdc record which has all the cdc fields when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.DATA_BEFORE_AFTER.

cdcRecord

public static org.apache.avro.generic.GenericData.Record cdcRecord(org.apache.avro.Schema cdcSchema,
                                                                   String op,
                                                                   String recordKey,
                                                                   org.apache.avro.generic.GenericRecord before)

Build the cdc record when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.DATA_BEFORE.

cdcRecord

public static org.apache.avro.generic.GenericData.Record cdcRecord(org.apache.avro.Schema cdcSchema,
                                                                   String op,
                                                                   String recordKey)

Build the cdc record when `hoodie.table.cdc.supplemental.logging.mode` is HoodieCDCSupplementalLoggingMode.OP_KEY_ONLY.

recordToJson

public static String recordToJson(org.apache.avro.generic.GenericRecord record)