org.apache.hudi.common.table.view

Interface TableFileSystemView.BaseFileOnlyViewWithLatestSlice

All Known Subinterfaces:

SyncableFileSystemView, TableFileSystemView.BaseFileOnlyView

All Known Implementing Classes:

AbstractTableFileSystemView, HoodieMetadataFileSystemView, HoodieTableFileSystemView, IncrementalTimelineSyncFileSystemView, PriorityBasedFileSystemView, RemoteHoodieTableFileSystemView, RocksDbBasedFileSystemView, SpillableMapBasedFileSystemView

Enclosing interface:

TableFileSystemView

public static interface TableFileSystemView.BaseFileOnlyViewWithLatestSlice

Methods to only access latest version of file for the instant(s) passed.

Method Summary

Modifier and Type	Method and Description
Map<String,Stream<HoodieBaseFile>>	getAllLatestBaseFilesBeforeOrOn(String maxCommitTime) Streams the latest version base files in all partitions with precondition that commitTime(file) before maxCommitTime.
Option<HoodieBaseFile>	getLatestBaseFile(String partitionPath, String fileId) Get Latest data file for a partition and file-Id.
Stream<HoodieBaseFile>	getLatestBaseFiles() Stream all the latest data files, in the file system view.
Stream<HoodieBaseFile>	getLatestBaseFiles(String partitionPath) Stream all the latest data files in the given partition.
Stream<HoodieBaseFile>	getLatestBaseFilesBeforeOrOn(String partitionPath, String maxCommitTime) Stream all the latest version data files in the given partition with precondition that commitTime(file) before maxCommitTime.
Stream<HoodieBaseFile>	getLatestBaseFilesInRange(List<String> commitsToReturn) Stream all the latest data files pass.

Method Detail

getLatestBaseFiles

Stream<HoodieBaseFile> getLatestBaseFiles(String partitionPath)

Stream all the latest data files in the given partition.

getLatestBaseFile

Option<HoodieBaseFile> getLatestBaseFile(String partitionPath,
                                         String fileId)

Get Latest data file for a partition and file-Id.

getLatestBaseFiles

Stream<HoodieBaseFile> getLatestBaseFiles()

Stream all the latest data files, in the file system view.

getLatestBaseFilesBeforeOrOn

Stream<HoodieBaseFile> getLatestBaseFilesBeforeOrOn(String partitionPath,
                                                    String maxCommitTime)

Stream all the latest version data files in the given partition with precondition that commitTime(file) before maxCommitTime.

getAllLatestBaseFilesBeforeOrOn

Map<String,Stream<HoodieBaseFile>> getAllLatestBaseFilesBeforeOrOn(String maxCommitTime)

Streams the latest version base files in all partitions with precondition that commitTime(file) before maxCommitTime.

Parameters:

maxCommitTime - The max commit time to consider.

Returns:

A Map of partition path to the latest version base files before or on the commit time

getLatestBaseFilesInRange

Stream<HoodieBaseFile> getLatestBaseFilesInRange(List<String> commitsToReturn)

Stream all the latest data files pass.