org.apache.hudi.integ.testsuite.helpers

类 DFSTestSuitePathSelector

java.lang.Object

org.apache.hudi.utilities.sources.helpers.DFSPathSelector

org.apache.hudi.integ.testsuite.helpers.DFSTestSuitePathSelector

所有已实现的接口:

Serializable

public class DFSTestSuitePathSelector
extends DFSPathSelector

A custom dfs path selector used only for the hudi test suite. To be used only if workload is not run inline.

另请参阅:

序列化表格

嵌套类概要

从类继承的嵌套类/接口 org.apache.hudi.utilities.sources.helpers.DFSPathSelector

DFSPathSelector.Config

字段概要

从类继承的字段 org.apache.hudi.utilities.sources.helpers.DFSPathSelector

fs, IGNORE_FILEPREFIX_LIST, props

构造器概要

构造器

构造器和说明
DFSTestSuitePathSelector(org.apache.hudi.common.config.TypedProperties props, org.apache.hadoop.conf.Configuration hadoopConf)

方法概要

限定符和类型	方法和说明
org.apache.hudi.common.util.collection.Pair<org.apache.hudi.common.util.Option<String>,String>	getNextFilePathsAndMaxModificationTime(org.apache.hudi.common.util.Option<String> lastCheckpointStr, long sourceLimit)

从类继承的方法 org.apache.hudi.utilities.sources.helpers.DFSPathSelector

createSourceSelector, getNextFilePathsAndMaxModificationTime, listEligibleFiles

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DFSTestSuitePathSelector

public DFSTestSuitePathSelector(org.apache.hudi.common.config.TypedProperties props,
                                org.apache.hadoop.conf.Configuration hadoopConf)

方法详细资料

getNextFilePathsAndMaxModificationTime

public org.apache.hudi.common.util.collection.Pair<org.apache.hudi.common.util.Option<String>,String> getNextFilePathsAndMaxModificationTime(org.apache.hudi.common.util.Option<String> lastCheckpointStr,
                                                                                                                                             long sourceLimit)

覆盖:

getNextFilePathsAndMaxModificationTime 在类中 DFSPathSelector