org.apache.hudi.common.table.view

Interface TableFileSystemView

All Known Subinterfaces:

SyncableFileSystemView

All Known Implementing Classes:

AbstractTableFileSystemView, HoodieMetadataFileSystemView, HoodieTableFileSystemView, IncrementalTimelineSyncFileSystemView, PriorityBasedFileSystemView, RemoteHoodieTableFileSystemView, RocksDbBasedFileSystemView, SpillableMapBasedFileSystemView

public interface TableFileSystemView

Interface for viewing the table file system.

Since:

0.3.0

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	TableFileSystemView.BaseFileOnlyView Methods to provide a view of base files only.
static interface	TableFileSystemView.BaseFileOnlyViewWithLatestSlice Methods to only access latest version of file for the instant(s) passed.
static interface	TableFileSystemView.SliceView Methods to access a combination of base files + log file slices.
static interface	TableFileSystemView.SliceViewWithLatestSlice Methods to only access latest version of file-slice for the instant(s) passed.

Method Summary

Modifier and Type	Method and Description
Stream<HoodieFileGroup>	getAllFileGroups(String partitionPath) Stream all the file groups for a given partition.
Stream<HoodieFileGroup>	getAllReplacedFileGroups(String partitionPath) Stream all the replaced file groups for given partition.
Stream<Pair<HoodieFileGroupId,HoodieInstant>>	getFileGroupsInPendingClustering() Filegroups that are in pending clustering.
Option<HoodieInstant>	getLastInstant() Last Known Instant on which the view is built.
Stream<Pair<String,CompactionOperation>>	getPendingCompactionOperations() Return Pending Compaction Operations.
Stream<HoodieFileGroup>	getReplacedFileGroupsBefore(String maxCommitTime, String partitionPath) Stream all the replaced file groups before maxCommitTime for given partition.
Stream<HoodieFileGroup>	getReplacedFileGroupsBeforeOrOn(String maxCommitTime, String partitionPath) Stream all the replaced file groups before or on maxCommitTime for given partition.
HoodieTimeline	getTimeline() Timeline corresponding to the view.

Method Detail

getAllFileGroups

Stream<HoodieFileGroup> getAllFileGroups(String partitionPath)

Stream all the file groups for a given partition.

getPendingCompactionOperations

Stream<Pair<String,CompactionOperation>> getPendingCompactionOperations()

Return Pending Compaction Operations.

Returns:

Pair>

getLastInstant

Option<HoodieInstant> getLastInstant()

Last Known Instant on which the view is built.

getTimeline

HoodieTimeline getTimeline()

Timeline corresponding to the view.

getReplacedFileGroupsBeforeOrOn

Stream<HoodieFileGroup> getReplacedFileGroupsBeforeOrOn(String maxCommitTime,
                                                        String partitionPath)

Stream all the replaced file groups before or on maxCommitTime for given partition.

getReplacedFileGroupsBefore

Stream<HoodieFileGroup> getReplacedFileGroupsBefore(String maxCommitTime,
                                                    String partitionPath)

Stream all the replaced file groups before maxCommitTime for given partition.

getAllReplacedFileGroups

Stream<HoodieFileGroup> getAllReplacedFileGroups(String partitionPath)

Stream all the replaced file groups for given partition.

getFileGroupsInPendingClustering

Stream<Pair<HoodieFileGroupId,HoodieInstant>> getFileGroupsInPendingClustering()

Filegroups that are in pending clustering.