| Constructor and Description |
|---|
SerializableConfiguration(SerializableConfiguration configuration) |
| Modifier and Type | Method and Description |
|---|---|
SerializableConfiguration |
HoodieEngineContext.getHadoopConf() |
| Constructor and Description |
|---|
HoodieEngineContext(SerializableConfiguration hadoopConf,
TaskContextSupplier taskContextSupplier) |
| Modifier and Type | Method and Description |
|---|---|
static boolean |
FSUtils.deleteSubPath(String subPathStr,
SerializableConfiguration conf,
boolean recursive)
Deletes a sub-path.
|
static HoodieWrapperFileSystem |
FSUtils.getFs(String path,
SerializableConfiguration hadoopConf,
ConsistencyGuardConfig consistencyGuardConfig)
Get the FS implementation for this table.
|
| Modifier and Type | Method and Description |
|---|---|
static <T> Map<String,T> |
FSUtils.parallelizeFilesProcess(HoodieEngineContext hoodieEngineContext,
org.apache.hadoop.fs.FileSystem fs,
int parallelism,
FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction,
List<String> subPaths) |
static <T> Map<String,T> |
FSUtils.parallelizeSubPathProcess(HoodieEngineContext hoodieEngineContext,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path dirPath,
int parallelism,
Predicate<org.apache.hadoop.fs.FileStatus> subPathPredicate,
FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction)
Processes sub-path in parallel.
|
| Modifier and Type | Field and Description |
|---|---|
protected SerializableConfiguration |
HoodieTableMetaClient.hadoopConf |
| Modifier and Type | Method and Description |
|---|---|
static Set<String> |
MarkerUtils.readMarkersFromFile(org.apache.hadoop.fs.Path markersFilePath,
SerializableConfiguration conf)
Reads the markers stored in the underlying file.
|
| Modifier and Type | Field and Description |
|---|---|
protected SerializableConfiguration |
BaseTableMetadata.hadoopConf |
| Modifier and Type | Method and Description |
|---|---|
SerializableConfiguration |
HoodieBackedTableMetadata.getHadoopConf() |
| Constructor and Description |
|---|
FileSystemBackedTableMetadata(HoodieEngineContext engineContext,
SerializableConfiguration conf,
String datasetBasePath,
boolean assumeDatePartitioning) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.