io.openlineage.spark.shade.extension.v1

Interface LineageRelation

public interface LineageRelation

Interface to be implemented for extension's classes extending `org.apache.spark.sql.sources.BaseRelation`. Implementing it allows extracting lineage from such objects. Implementing `getNamespace` and `getName` within the `DatasetIdentifier` is obligatory.

Method Summary

Modifier and Type	Method and Description
io.openlineage.client.utils.DatasetIdentifier	getLineageDatasetIdentifier(java.lang.String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)

Method Detail

getLineageDatasetIdentifier

io.openlineage.client.utils.DatasetIdentifier getLineageDatasetIdentifier(java.lang.String sparkListenerEventName,
                                                                          io.openlineage.client.OpenLineage openLineage)