io.openlineage.spark.shade.extension.v1

Interface OutputLineageNode

public interface OutputLineageNode

Interface to be implemented for LogicalPlan nodes to extract lineage information about output datasets.

Method Summary

Modifier and Type	Method and Description
java.util.List<OutputDatasetWithFacets>	getOutputs(java.lang.String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage) Gets output dataset read by this LogicalPlans node

Method Detail

getOutputs

java.util.List<OutputDatasetWithFacets> getOutputs(java.lang.String sparkListenerEventName,
                                                   io.openlineage.client.OpenLineage openLineage)

Gets output dataset read by this LogicalPlans node

Parameters:

sparkListenerEventName - class name of SparkListenerEvent that triggered OpenLineageSparkListener

openLineage - instance to create OpenLineage objects

Returns:

list of dataset with facets