com.linkedin.feathr.core.config.producer.anchors

Class LateralViewParams

java.lang.Object

com.linkedin.feathr.core.config.producer.anchors.LateralViewParams

public final class LateralViewParams
extends java.lang.Object

Some feature datasets may contain feature values as an array of tuples. These are typically the result of some aggregation operation. To perform further aggregation on these tuples, for example, rollups from say, daily to weekly, the individual tuples have to be extracted, joined with observation data, and aggregated.

The extraction can be performed by using Spark's lateral view in the FROM clause. The lateral view can be used to generate zero or more output rows from a single input row which is exactly what we need. This class specifies the parameters needed to construct the lateral view. A LateralViewParams is an optional parameter, and if specified it's applicable only for Sliding-window aggregation features. Further, it's specified once in the enclosing anchor.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	LATERAL_VIEW_DEF
static java.lang.String	LATERAL_VIEW_FILTER
static java.lang.String	LATERAL_VIEW_ITEM_ALIAS

Constructor Summary

Constructors

Constructor and Description
LateralViewParams(java.lang.String def, java.lang.String itemAlias) Constructor
LateralViewParams(java.lang.String def, java.lang.String itemAlias, java.lang.String filter) Constructor

Method Summary

Modifier and Type	Method and Description
boolean	equals(java.lang.Object o)
java.lang.String	getDef()
java.util.Optional<java.lang.String>	getFilter()
java.lang.String	getItemAlias()
int	hashCode()
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

LATERAL_VIEW_DEF

public static final java.lang.String LATERAL_VIEW_DEF

See Also:

Constant Field Values

LATERAL_VIEW_ITEM_ALIAS

public static final java.lang.String LATERAL_VIEW_ITEM_ALIAS

See Also:

Constant Field Values

LATERAL_VIEW_FILTER

public static final java.lang.String LATERAL_VIEW_FILTER

See Also:

Constant Field Values

Constructor Detail

LateralViewParams

public LateralViewParams(java.lang.String def,
                         java.lang.String itemAlias,
                         java.lang.String filter)

Constructor

Parameters:

def - A table-generating function. Typically it's explode(...)

itemAlias - User-defined alias for the generated table

filter - A filter expression applied to the elements/tuples in the input row. Optional parameter.

LateralViewParams

public LateralViewParams(java.lang.String def,
                         java.lang.String itemAlias)

Constructor

Parameters:

def - A table-generating function. Typically it's explode(...)

itemAlias - User-defined alias for the generated table

Method Detail

getDef

public java.lang.String getDef()

getItemAlias

public java.lang.String getItemAlias()

getFilter

public java.util.Optional<java.lang.String> getFilter()

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

equals

public boolean equals(java.lang.Object o)

Overrides:

equals in class java.lang.Object

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object