org.apache.hudi

类 HoodieDataSourceHelpers

java.lang.Object

org.apache.hudi.HoodieDataSourceHelpers

@PublicAPIClass(maturity=STABLE)
public class HoodieDataSourceHelpers
extends Object

List of helpers to aid, construction of instanttime for read and write operations using datasource.

构造器概要

构造器

构造器和说明
HoodieDataSourceHelpers()

方法概要

限定符和类型	方法和说明
static HoodieTimeline	allCompletedCommitsCompactions(org.apache.hadoop.fs.FileSystem fs, String basePath) Obtain all the commits, compactions that have occurred on the timeline, whose instant times could be fed into the datasource options.
static Option<HoodieClusteringPlan>	getClusteringPlan(org.apache.hadoop.fs.FileSystem fs, String basePath, String instantTime)
static boolean	hasNewCommits(org.apache.hadoop.fs.FileSystem fs, String basePath, String commitTimestamp) Checks if the Hoodie table has new data since given timestamp.
static String	latestCommit(org.apache.hadoop.fs.FileSystem fs, String basePath) Returns the last successful write operation's instant time.
static List<String>	listCommitsSince(org.apache.hadoop.fs.FileSystem fs, String basePath, String instantTimestamp) Get a list of instant times that have occurred, from the given instant timestamp.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HoodieDataSourceHelpers

public HoodieDataSourceHelpers()

方法详细资料

hasNewCommits

@PublicAPIMethod(maturity=STABLE)
public static boolean hasNewCommits(org.apache.hadoop.fs.FileSystem fs,
                                                                      String basePath,
                                                                      String commitTimestamp)

Checks if the Hoodie table has new data since given timestamp. This can be subsequently fed to an incremental view read, to perform incremental processing.

listCommitsSince

@PublicAPIMethod(maturity=STABLE)
public static List<String> listCommitsSince(org.apache.hadoop.fs.FileSystem fs,
                                                                              String basePath,
                                                                              String instantTimestamp)

Get a list of instant times that have occurred, from the given instant timestamp.

latestCommit

@PublicAPIMethod(maturity=STABLE)
public static String latestCommit(org.apache.hadoop.fs.FileSystem fs,
                                                                    String basePath)

Returns the last successful write operation's instant time.

allCompletedCommitsCompactions

@PublicAPIMethod(maturity=STABLE)
public static HoodieTimeline allCompletedCommitsCompactions(org.apache.hadoop.fs.FileSystem fs,
                                                                                              String basePath)

Obtain all the commits, compactions that have occurred on the timeline, whose instant times could be fed into the datasource options.

getClusteringPlan

@PublicAPIMethod(maturity=STABLE)
public static Option<HoodieClusteringPlan> getClusteringPlan(org.apache.hadoop.fs.FileSystem fs,
                                                                                               String basePath,
                                                                                               String instantTime)