Uses of Class
org.apache.hudi.common.engine.HoodieEngineContext

Packages that use HoodieEngineContext

Package	Description
org.apache.hudi
org.apache.hudi.common.engine
org.apache.hudi.common.fs
org.apache.hudi.common.table.view
org.apache.hudi.common.util
org.apache.hudi.metadata

Uses of HoodieEngineContext in org.apache.hudi

Constructors in org.apache.hudi with parameters of type HoodieEngineContext

Constructor and Description
BaseHoodieTableFileIndex(HoodieEngineContext engineContext, HoodieTableMetaClient metaClient, TypedProperties configProperties, HoodieTableQueryType queryType, List<org.apache.hadoop.fs.Path> queryPaths, Option<String> specifiedQueryInstant, boolean shouldIncludePendingCommits, boolean shouldValidateInstant, BaseHoodieTableFileIndex.FileStatusCache fileStatusCache)

Uses of HoodieEngineContext in org.apache.hudi.common.engine

Subclasses of HoodieEngineContext in org.apache.hudi.common.engine

Modifier and Type	Class and Description
class	HoodieLocalEngineContext A java based engine context, use this implementation on the query engine integrations if needed.

Uses of HoodieEngineContext in org.apache.hudi.common.fs

Methods in org.apache.hudi.common.fs with parameters of type HoodieEngineContext

Modifier and Type	Method and Description
static boolean	FSUtils.deleteDir(HoodieEngineContext hoodieEngineContext, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dirPath, int parallelism) Deletes a directory by deleting sub-paths in parallel on the file system.
static List<String>	FSUtils.getAllPartitionPaths(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String basePathStr)
static List<String>	FSUtils.getAllPartitionPaths(HoodieEngineContext engineContext, String basePathStr, boolean useFileListingFromMetadata, boolean assumeDatePartitioning)
static Map<String,org.apache.hadoop.fs.FileStatus[]>	FSUtils.getFilesInPartitions(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String basePathStr, String[] partitionPaths, String spillableMapPath)
static List<org.apache.hadoop.fs.FileStatus>	FSUtils.getFileStatusAtLevel(HoodieEngineContext hoodieEngineContext, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path rootPath, int expectLevel, int parallelism) Lists file status at a certain level in the directory hierarchy.
static <T> Map<String,T>	FSUtils.parallelizeFilesProcess(HoodieEngineContext hoodieEngineContext, org.apache.hadoop.fs.FileSystem fs, int parallelism, FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction, List<String> subPaths)
static <T> Map<String,T>	FSUtils.parallelizeSubPathProcess(HoodieEngineContext hoodieEngineContext, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dirPath, int parallelism, Predicate<org.apache.hadoop.fs.FileStatus> subPathPredicate, FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction) Processes sub-path in parallel.

Uses of HoodieEngineContext in org.apache.hudi.common.table.view

Methods in org.apache.hudi.common.table.view with parameters of type HoodieEngineContext

Modifier and Type	Method and Description
static HoodieTableFileSystemView	FileSystemViewManager.createInMemoryFileSystemView(HoodieEngineContext engineContext, HoodieTableMetaClient metaClient, HoodieMetadataConfig metadataConfig)
static HoodieTableFileSystemView	FileSystemViewManager.createInMemoryFileSystemViewWithTimeline(HoodieEngineContext engineContext, HoodieTableMetaClient metaClient, HoodieMetadataConfig metadataConfig, HoodieTimeline timeline)
static FileSystemViewManager	FileSystemViewManager.createViewManager(HoodieEngineContext context, HoodieMetadataConfig metadataConfig, FileSystemViewStorageConfig config, HoodieCommonConfig commonConfig)
static FileSystemViewManager	FileSystemViewManager.createViewManager(HoodieEngineContext context, HoodieMetadataConfig metadataConfig, FileSystemViewStorageConfig config, HoodieCommonConfig commonConfig, SerializableSupplier<HoodieTableMetadata> metadataSupplier) Main Factory method for building file-system views.
static FileSystemViewManager	FileSystemViewManager.createViewManager(HoodieEngineContext context, HoodieMetadataConfig metadataConfig, FileSystemViewStorageConfig config, HoodieCommonConfig commonConfig, String basePath)

Uses of HoodieEngineContext in org.apache.hudi.common.util

Methods in org.apache.hudi.common.util with parameters of type HoodieEngineContext

Modifier and Type	Method and Description
static Map<String,Set<String>>	MarkerUtils.readTimelineServerBasedMarkersFromFileSystem(String markerDir, org.apache.hadoop.fs.FileSystem fileSystem, HoodieEngineContext context, int parallelism) Reads files containing the markers written by timeline-server-based marker mechanism.

Uses of HoodieEngineContext in org.apache.hudi.metadata

Fields in org.apache.hudi.metadata declared as HoodieEngineContext

Modifier and Type	Field and Description
protected HoodieEngineContext	BaseTableMetadata.engineContext

Methods in org.apache.hudi.metadata that return HoodieEngineContext

Modifier and Type	Method and Description
protected HoodieEngineContext	BaseTableMetadata.getEngineContext()

Methods in org.apache.hudi.metadata with parameters of type HoodieEngineContext

Modifier and Type	Method and Description
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertFilesToBloomFilterRecords(HoodieEngineContext engineContext, Map<String,List<String>> partitionToDeletedFiles, Map<String,Map<String,Long>> partitionToAppendedFiles, MetadataRecordsGenerationParams recordsGenerationParams, String instantTime) Convert added and deleted files metadata to bloom filter index records.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertFilesToColumnStatsRecords(HoodieEngineContext engineContext, Map<String,List<String>> partitionToDeletedFiles, Map<String,Map<String,Long>> partitionToAppendedFiles, MetadataRecordsGenerationParams recordsGenerationParams) Convert added and deleted action metadata to column stats index records.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertMetadataToBloomFilterRecords(HoodieCleanMetadata cleanMetadata, HoodieEngineContext engineContext, String instantTime, MetadataRecordsGenerationParams recordsGenerationParams) Convert clean metadata to bloom filter index records.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertMetadataToBloomFilterRecords(HoodieEngineContext context, HoodieCommitMetadata commitMetadata, String instantTime, MetadataRecordsGenerationParams recordsGenerationParams) Convert commit action metadata to bloom filter records.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertMetadataToColumnStatsRecords(HoodieCleanMetadata cleanMetadata, HoodieEngineContext engineContext, MetadataRecordsGenerationParams recordsGenerationParams) Convert clean metadata to column stats index records.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.convertMetadataToColumnStatsRecords(HoodieCommitMetadata commitMetadata, HoodieEngineContext engineContext, MetadataRecordsGenerationParams recordsGenerationParams)
static Map<MetadataPartitionType,HoodieData<HoodieRecord>>	HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext, HoodieActiveTimeline metadataTableTimeline, HoodieRestoreMetadata restoreMetadata, MetadataRecordsGenerationParams recordsGenerationParams, String instantTime, Option<String> lastSyncTs) Convert restore action metadata to metadata table records.
static Map<MetadataPartitionType,HoodieData<HoodieRecord>>	HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext, HoodieActiveTimeline metadataTableTimeline, HoodieRollbackMetadata rollbackMetadata, MetadataRecordsGenerationParams recordsGenerationParams, String instantTime, Option<String> lastSyncTs, boolean wasSynced) Convert rollback action metadata to metadata table records.
static Map<MetadataPartitionType,HoodieData<HoodieRecord>>	HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext, HoodieCleanMetadata cleanMetadata, MetadataRecordsGenerationParams recordsGenerationParams, String instantTime) Convert the clean action to metadata records.
static Map<MetadataPartitionType,HoodieData<HoodieRecord>>	HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext context, HoodieCommitMetadata commitMetadata, String instantTime, MetadataRecordsGenerationParams recordsGenerationParams) Convert commit action to metadata records for the enabled partition types.
static HoodieTableMetadata	HoodieTableMetadata.create(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath, String spillableMapPath)
static HoodieTableMetadata	HoodieTableMetadata.create(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath, String spillableMapPath, boolean reuse)
static FileSystemBackedTableMetadata	HoodieTableMetadata.createFSBackedTableMetadata(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath)
static HoodieBackedTableMetadata	HoodieTableMetadata.createHoodieBackedTableMetadata(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath, String spillableMapPath, boolean reuse)
static void	HoodieTableMetadataUtil.deleteMetadataPartition(String basePath, HoodieEngineContext context, MetadataPartitionType partitionType) Deletes the metadata partition from the file system.
static void	HoodieTableMetadataUtil.deleteMetadataTable(String basePath, HoodieEngineContext context) Delete the metadata table for the dataset.
static boolean	HoodieTableMetadataUtil.metadataPartitionExists(String basePath, HoodieEngineContext context, MetadataPartitionType partitionType) Check if the given metadata partition exists.

Constructors in org.apache.hudi.metadata with parameters of type HoodieEngineContext

Constructor and Description
BaseTableMetadata(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String dataBasePath, String spillableMapDirectory)
FileSystemBackedTableMetadata(HoodieEngineContext engineContext, SerializableConfiguration conf, String datasetBasePath, boolean assumeDatePartitioning)
HoodieBackedTableMetadata(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath, String spillableMapDirectory)
HoodieBackedTableMetadata(HoodieEngineContext engineContext, HoodieMetadataConfig metadataConfig, String datasetBasePath, String spillableMapDirectory, boolean reuse)
HoodieMetadataFileSystemView(HoodieEngineContext engineContext, HoodieTableMetaClient metaClient, HoodieTimeline visibleActiveTimeline, HoodieMetadataConfig metadataConfig)