| Constructor and Description |
|---|
BaseHoodieTableFileIndex(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
TypedProperties configProperties,
HoodieTableQueryType queryType,
List<org.apache.hadoop.fs.Path> queryPaths,
Option<String> specifiedQueryInstant,
boolean shouldIncludePendingCommits,
boolean shouldValidateInstant,
BaseHoodieTableFileIndex.FileStatusCache fileStatusCache) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieTableMetaClient |
BootstrapIndex.metaClient |
protected HoodieTableMetaClient |
BootstrapIndex.IndexReader.metaClient |
protected HoodieTableMetaClient |
BootstrapIndex.IndexWriter.metaClient |
| Modifier and Type | Method and Description |
|---|---|
static BootstrapIndex |
BootstrapIndex.getBootstrapIndex(HoodieTableMetaClient metaClient) |
| Constructor and Description |
|---|
BootstrapIndex(HoodieTableMetaClient metaClient) |
HFileBootstrapIndex(HoodieTableMetaClient metaClient) |
HFileBootstrapIndexReader(HoodieTableMetaClient metaClient) |
IndexReader(HoodieTableMetaClient metaClient) |
IndexWriter(HoodieTableMetaClient metaClient) |
NoOpBootstrapIndex(HoodieTableMetaClient metaClient) |
| Modifier and Type | Method and Description |
|---|---|
HoodieTableMetaClient |
HoodieTableMetaClient.Builder.build() |
HoodieTableMetaClient |
HoodieTableMetaClient.PropertyBuilder.initTable(org.apache.hadoop.conf.Configuration configuration,
String basePath)
Init Table with the properties build by this builder.
|
static HoodieTableMetaClient |
HoodieTableMetaClient.initTableAndGetMetaClient(org.apache.hadoop.conf.Configuration hadoopConf,
String basePath,
Properties props)
Helper method to initialize a given path as a hoodie table with configs passed in as Properties.
|
static HoodieTableMetaClient |
HoodieTableMetaClient.reload(HoodieTableMetaClient oldMetaClient) |
| Modifier and Type | Method and Description |
|---|---|
HoodieTableMetaClient.PropertyBuilder |
HoodieTableMetaClient.PropertyBuilder.fromMetaClient(HoodieTableMetaClient metaClient) |
static HoodieTableMetaClient |
HoodieTableMetaClient.reload(HoodieTableMetaClient oldMetaClient) |
| Constructor and Description |
|---|
TableSchemaResolver(HoodieTableMetaClient metaClient) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieTableMetaClient |
HoodieActiveTimeline.metaClient |
| Modifier and Type | Method and Description |
|---|---|
static Map<String,Option<String>> |
TimelineUtils.getAllExtraMetadataForKey(HoodieTableMetaClient metaClient,
String extraMetadataKey)
Get extra metadata for specified key from all active commit/deltacommit instants.
|
static Option<String> |
TimelineUtils.getExtraMetadataFromLatest(HoodieTableMetaClient metaClient,
String extraMetadataKey)
Get extra metadata for specified key from latest commit/deltacommit/replacecommit(eg.
|
static Option<String> |
TimelineUtils.getExtraMetadataFromLatestIncludeClustering(HoodieTableMetaClient metaClient,
String extraMetadataKey)
Get extra metadata for specified key from latest commit/deltacommit/replacecommit instant including internal commits
such as clustering.
|
static HoodieDefaultTimeline |
TimelineUtils.getTimeline(HoodieTableMetaClient metaClient,
boolean includeArchivedTimeline) |
static boolean |
TimelineUtils.isClusteringCommit(HoodieTableMetaClient metaClient,
HoodieInstant instant) |
| Constructor and Description |
|---|
HoodieActiveTimeline(HoodieTableMetaClient metaClient) |
HoodieActiveTimeline(HoodieTableMetaClient metaClient,
boolean applyLayoutFilter) |
HoodieActiveTimeline(HoodieTableMetaClient metaClient,
Set<String> includedExtensions) |
HoodieActiveTimeline(HoodieTableMetaClient metaClient,
Set<String> includedExtensions,
boolean applyLayoutFilters) |
HoodieArchivedTimeline(HoodieTableMetaClient metaClient)
Loads all the archived instants.
|
HoodieArchivedTimeline(HoodieTableMetaClient metaClient,
String startTs)
Loads completed instants from startTs(inclusive).
|
| Modifier and Type | Method and Description |
|---|---|
static HoodieFileGroup |
FileGroupDTO.toFileGroup(FileGroupDTO dto,
HoodieTableMetaClient metaClient) |
static HoodieTimeline |
TimelineDTO.toTimeline(TimelineDTO dto,
HoodieTableMetaClient metaClient) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieTableMetaClient |
AbstractMigratorBase.metaClient |
| Constructor and Description |
|---|
AbstractMigratorBase(HoodieTableMetaClient metaClient) |
MetadataMigrator(HoodieTableMetaClient metaClient,
List<VersionMigrator<T>> migratorList) |
| Constructor and Description |
|---|
CleanMetadataMigrator(HoodieTableMetaClient metaClient) |
CleanMetadataV1MigrationHandler(HoodieTableMetaClient metaClient) |
CleanMetadataV2MigrationHandler(HoodieTableMetaClient metaClient) |
CleanPlanMigrator(HoodieTableMetaClient metaClient) |
CleanPlanV1MigrationHandler(HoodieTableMetaClient metaClient) |
CleanPlanV2MigrationHandler(HoodieTableMetaClient metaClient) |
| Constructor and Description |
|---|
CompactionPlanMigrator(HoodieTableMetaClient metaClient) |
CompactionV1MigrationHandler(HoodieTableMetaClient metaClient) |
CompactionV2MigrationHandler(HoodieTableMetaClient metaClient) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieTableMetaClient |
AbstractTableFileSystemView.metaClient |
| Modifier and Type | Method and Description |
|---|---|
static HoodieTableFileSystemView |
FileSystemViewManager.createInMemoryFileSystemView(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
HoodieMetadataConfig metadataConfig) |
static HoodieTableFileSystemView |
FileSystemViewManager.createInMemoryFileSystemViewWithTimeline(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
HoodieMetadataConfig metadataConfig,
HoodieTimeline timeline) |
SyncableFileSystemView |
FileSystemViewManager.getFileSystemView(HoodieTableMetaClient metaClient)
Main API to get the file-system view for the base-path.
|
void |
HoodieTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline) |
protected void |
RocksDbBasedFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline) |
protected void |
AbstractTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline)
Initialize the view.
|
void |
HoodieTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses) |
| Constructor and Description |
|---|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline)
Create a file system view, as of the given timeline.
|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
boolean enableIncrementalTimelineSync)
Create a file system view, as of the given timeline.
|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses)
Create a file system view, as of the given timeline, with the provided file statuses.
|
HoodieTablePreCommitFileSystemView(HoodieTableMetaClient metaClient,
SyncableFileSystemView completedCommitsFileSystemView,
List<HoodieWriteStat> filesWritten,
Map<String,List<String>> partitionToReplaceFileIds,
String instantTime)
Create a file system view for the inflight commit that we are validating.
|
RemoteHoodieTableFileSystemView(HoodieTableMetaClient metaClient,
FileSystemViewStorageConfig viewConf) |
RemoteHoodieTableFileSystemView(String server,
int port,
HoodieTableMetaClient metaClient) |
RocksDbBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses,
FileSystemViewStorageConfig config) |
RocksDbBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
FileSystemViewStorageConfig config) |
SpillableMapBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses,
FileSystemViewStorageConfig config,
HoodieCommonConfig commonConfig) |
SpillableMapBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
FileSystemViewStorageConfig config,
HoodieCommonConfig commonConfig) |
| Modifier and Type | Method and Description |
|---|---|
static Map<HoodieFileGroupId,HoodieInstant> |
ClusteringUtils.getAllFileGroupsInPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get filegroups to pending clustering instant mapping for all pending clustering plans.
|
static Stream<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getAllPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get all pending clustering plans along with their instants.
|
static Map<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>> |
CompactionUtils.getAllPendingCompactionOperations(HoodieTableMetaClient metaClient)
Get all PartitionPath + file-ids with pending Compaction operations and their target compaction instant time.
|
static List<Pair<HoodieInstant,HoodieCompactionPlan>> |
CompactionUtils.getAllPendingCompactionPlans(HoodieTableMetaClient metaClient)
Get all pending compaction plans along with their instants.
|
static HoodieCleanMetadata |
CleanerUtils.getCleanerMetadata(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest Version of Hoodie Cleaner Metadata - Output of cleaner operation.
|
static HoodieCleanerPlan |
CleanerUtils.getCleanerPlan(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest version of cleaner plan corresponding to a clean instant.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTableMetaClient metaClient,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static HoodieCompactionPlan |
CompactionUtils.getCompactionPlan(HoodieTableMetaClient metaClient,
String compactionInstant) |
static BaseFileUtils |
BaseFileUtils.getInstance(HoodieTableMetaClient metaClient) |
static Pair<Option<String>,Option<String>> |
InternalSchemaCache.getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient,
String compactionAndClusteringInstant)
Get internalSchema and avroSchema for compaction/cluster operation.
|
static List<HoodieInstant> |
ClusteringUtils.getPendingClusteringInstantTimes(HoodieTableMetaClient metaClient) |
static List<HoodieInstant> |
CompactionUtils.getPendingCompactionInstantTimes(HoodieTableMetaClient metaClient)
Return all pending compaction instant times.
|
static boolean |
ClusteringUtils.isPendingClusteringInstant(HoodieTableMetaClient metaClient,
HoodieInstant instant) |
static InternalSchema |
InternalSchemaCache.searchSchemaAndCache(long versionID,
HoodieTableMetaClient metaClient,
boolean cacheEnable)
Search internalSchema based on versionID.
|
| Constructor and Description |
|---|
RocksDBSchemaHelper(HoodieTableMetaClient metaClient) |
| Constructor and Description |
|---|
FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieTableMetaClient |
BaseTableMetadata.dataMetaClient |
| Modifier and Type | Method and Description |
|---|---|
HoodieTableMetaClient |
MetadataRecordsGenerationParams.getDataMetaClient()
Deprecated.
|
HoodieTableMetaClient |
HoodieBackedTableMetadata.getMetadataMetaClient() |
| Modifier and Type | Method and Description |
|---|---|
static HoodieTableFileSystemView |
HoodieTableMetadataUtil.getFileSystemView(HoodieTableMetaClient metaClient)
Get metadata table file system view.
|
static List<FileSlice> |
HoodieTableMetadataUtil.getPartitionLatestFileSlices(HoodieTableMetaClient metaClient,
Option<HoodieTableFileSystemView> fsView,
String partition)
Get the latest file slices for a Metadata Table partition.
|
static List<FileSlice> |
HoodieTableMetadataUtil.getPartitionLatestFileSlicesIncludingInflight(HoodieTableMetaClient metaClient,
Option<HoodieTableFileSystemView> fileSystemView,
String partition)
Get the latest file slices for a given partition including the inflight ones.
|
static List<FileSlice> |
HoodieTableMetadataUtil.getPartitionLatestMergedFileSlices(HoodieTableMetaClient metaClient,
HoodieTableFileSystemView fsView,
String partition)
Get the latest file slices for a Metadata Table partition.
|
Map<String,String> |
HoodieMetadataMetrics.getStats(boolean detailed,
HoodieTableMetaClient metaClient,
HoodieTableMetadata metadata) |
static boolean |
HoodieTableMetadataUtil.isFilesPartitionAvailable(HoodieTableMetaClient metaClient)
Returns whether the files partition of metadata table is ready for read.
|
void |
HoodieMetadataMetrics.updateSizeMetrics(HoodieTableMetaClient metaClient,
HoodieBackedTableMetadata metadata) |
| Modifier and Type | Method and Description |
|---|---|
static int |
HoodieTableMetadataUtil.getPartitionFileGroupCount(MetadataPartitionType partitionType,
Option<HoodieTableMetaClient> metaClient,
Option<HoodieTableFileSystemView> fsView,
HoodieMetadataConfig metadataConfig,
boolean isBootstrapCompleted)
Get file group count for a metadata table partition.
|
| Constructor and Description |
|---|
HoodieMetadataFileSystemView(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
HoodieMetadataConfig metadataConfig) |
HoodieMetadataFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
HoodieTableMetadata tableMetadata) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.