org.apache.hudi.common.table.cdc

Class HoodieCDCExtractor

java.lang.Object

org.apache.hudi.common.table.cdc.HoodieCDCExtractor

public class HoodieCDCExtractor
extends Object

This class helps to extract all the information which will be used when CDC query. There are some steps: 1. filter out the completed commit instants, and get the related HoodieCommitMetadata objects. 2. initialize the HoodieTableFileSystemView by the touched data files. 3. extract the cdc information: generate a HoodieCDCFileSplit object for each of the instant in (startInstant, endInstant) and each of the file group which is touched in the range of instants.

Constructor Summary

Constructors

Constructor and Description
HoodieCDCExtractor(HoodieTableMetaClient metaClient, InstantRange range)

Method Summary

Modifier and Type	Method and Description
Map<HoodieFileGroupId,List<HoodieCDCFileSplit>>	extractCDCFileSplits() At the granularity of a file group, trace the mapping between each commit/instant and changes to this file group.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieCDCExtractor

public HoodieCDCExtractor(HoodieTableMetaClient metaClient,
                          InstantRange range)

Method Detail

extractCDCFileSplits

public Map<HoodieFileGroupId,List<HoodieCDCFileSplit>> extractCDCFileSplits()

At the granularity of a file group, trace the mapping between each commit/instant and changes to this file group.