com.linkedin.feathr.core.config.producer.sources

Class HdfsConfig

java.lang.Object

com.linkedin.feathr.core.config.producer.sources.SourceConfig

com.linkedin.feathr.core.config.producer.sources.HdfsConfig

All Implemented Interfaces:

ConfigObj, java.io.Serializable

Direct Known Subclasses:

HdfsConfigWithRegularData, HdfsConfigWithSlidingWindow

public abstract class HdfsConfig
extends SourceConfig

Abstract class for all HDFS config classes

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	HAS_TIME_SNAPSHOT
static java.lang.String	PATH
static java.lang.String	TIME_PARTITION_PATTERN

Fields inherited from class com.linkedin.feathr.core.config.producer.sources.SourceConfig

_sourceName, TYPE

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	HdfsConfig(java.lang.String sourceName, java.lang.String path) Constructor
protected	HdfsConfig(java.lang.String sourceName, java.lang.String path, java.lang.String timePartitionPattern) Constructor

Method Summary

Modifier and Type	Method and Description
boolean	equals(java.lang.Object o)
java.lang.String	getPath()
SourceType	getSourceType()
java.util.Optional<java.lang.String>	getTimePartitionPattern()
int	hashCode()
java.lang.String	toString()

Methods inherited from class com.linkedin.feathr.core.config.producer.sources.SourceConfig

getSourceName

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

PATH

public static final java.lang.String PATH

See Also:

Constant Field Values

HAS_TIME_SNAPSHOT

public static final java.lang.String HAS_TIME_SNAPSHOT

See Also:

Constant Field Values

TIME_PARTITION_PATTERN

public static final java.lang.String TIME_PARTITION_PATTERN

See Also:

Constant Field Values

Constructor Detail

HdfsConfig

protected HdfsConfig(java.lang.String sourceName,
                     java.lang.String path,
                     java.lang.String timePartitionPattern)

Constructor

Parameters:

sourceName - the name of the source and it is referenced by the anchor in the feature definition

path - HDFS path or Dali URI used to access HDFS

timePartitionPattern - format of the time partitioned feature

HdfsConfig

protected HdfsConfig(java.lang.String sourceName,
                     java.lang.String path)

Constructor

Parameters:

path - HDFS path or Dali URI used to access HDFS

Method Detail

getPath

public java.lang.String getPath()

getTimePartitionPattern

public java.util.Optional<java.lang.String> getTimePartitionPattern()

getSourceType

public SourceType getSourceType()

Specified by:

getSourceType in class SourceConfig

equals

public boolean equals(java.lang.Object o)

Overrides:

equals in class SourceConfig

hashCode

public int hashCode()

Overrides:

hashCode in class SourceConfig

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object