org.apache.hudi.common.table.view

Class HoodieTablePreCommitFileSystemView

java.lang.Object

org.apache.hudi.common.table.view.HoodieTablePreCommitFileSystemView

public class HoodieTablePreCommitFileSystemView
extends Object

Create PreCommitFileSystemView by only filtering instants that are of interest. For example, we want to exclude other inflight instants. This is achieved by combining 1) FileSystemView with completed commits 2) Using list of files written/replaced by inflight instant that we are validating

Constructor Summary

Constructors

Constructor and Description
HoodieTablePreCommitFileSystemView(HoodieTableMetaClient metaClient, SyncableFileSystemView completedCommitsFileSystemView, List<HoodieWriteStat> filesWritten, Map<String,List<String>> partitionToReplaceFileIds, String instantTime) Create a file system view for the inflight commit that we are validating.

Method Summary

Modifier and Type	Method and Description
Stream<HoodieBaseFile>	getLatestBaseFiles(String partitionStr) Combine committed base files + new files created/replaced for given partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieTablePreCommitFileSystemView

public HoodieTablePreCommitFileSystemView(HoodieTableMetaClient metaClient,
                                          SyncableFileSystemView completedCommitsFileSystemView,
                                          List<HoodieWriteStat> filesWritten,
                                          Map<String,List<String>> partitionToReplaceFileIds,
                                          String instantTime)

Create a file system view for the inflight commit that we are validating.

Method Detail

getLatestBaseFiles

public final Stream<HoodieBaseFile> getLatestBaseFiles(String partitionStr)

Combine committed base files + new files created/replaced for given partition.