| Package | Description |
|---|---|
| org.apache.hudi.common.fs |
| Modifier and Type | Method and Description |
|---|---|
static <T> Map<String,T> |
FSUtils.parallelizeFilesProcess(HoodieEngineContext hoodieEngineContext,
org.apache.hadoop.fs.FileSystem fs,
int parallelism,
FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction,
List<String> subPaths) |
static <T> Map<String,T> |
FSUtils.parallelizeSubPathProcess(HoodieEngineContext hoodieEngineContext,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path dirPath,
int parallelism,
Predicate<org.apache.hadoop.fs.FileStatus> subPathPredicate,
FSUtils.SerializableFunction<Pair<String,SerializableConfiguration>,T> pairFunction)
Processes sub-path in parallel.
|
Copyright © 2022 The Apache Software Foundation. All rights reserved.