io.openlineage.spark.shade.extension.v1

Interface InputLineageNode

public interface InputLineageNode

Interface to be implemented for LogicalPlan nodes to extract lineage information about input datasets.

Method Summary

Modifier and Type	Method and Description
java.util.List<InputDatasetWithFacets>	getInputs(java.lang.String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage) Gets input dataset read by this LogicalPlans node

Method Detail

getInputs

java.util.List<InputDatasetWithFacets> getInputs(java.lang.String sparkListenerEventName,
                                                 io.openlineage.client.OpenLineage openLineage)

Gets input dataset read by this LogicalPlans node

Parameters:

sparkListenerEventName - class name of SparkListenerEvent that triggered OpenLineageSparkListener

openLineage - instance to create OpenLineage objects

Returns:

list of input datasets with facets