Index

A E G H I L O S
All Classes and Interfaces|All Packages

A

apply(Object, String) - Method in class io.openlineage.spark.shade.extension.v1.lifecycle.plan.SparkOpenLineageExtensionVisitor

Applies the visitor to a LineageRelation, InputLineageNode, or OutputLineageNode, extracting and serializing the relevant lineage information.

apply(Object, String, Object, Object) - Method in class io.openlineage.spark.shade.extension.v1.lifecycle.plan.SparkOpenLineageExtensionVisitor

Applies the visitor to a LineageRelationProvider, extracting lineage information such as the DatasetIdentifier from the provided lineageNode.

E

equals(Object) - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

equals(Object) - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

equals(Object) - Method in class io.openlineage.spark.shade.extension.v1.OlExprId

equals(Object) - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

equals(Object) - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

G

getDatasetFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetFacetsBuilder() - Method in interface io.openlineage.spark.shade.extension.v1.InputDatasetWithFacets

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetFacetsBuilder() - Method in interface io.openlineage.spark.shade.extension.v1.OutputDatasetWithFacets

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

Returns the OpenLineage.DatasetFacetsBuilder for building dataset facets.

getDatasetIdentifier() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

Returns the DatasetIdentifier that contains the dataset's namespace and name.

getDatasetIdentifier() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

Returns the DatasetIdentifier that contains the dataset's namespace and name.

getExprId() - Method in class io.openlineage.spark.shade.extension.v1.OlExprId

Returns the expression identifier.

getInputFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

Returns the OpenLineage.InputDatasetInputFacetsBuilder for building input dataset facets.

getInputFacetsBuilder() - Method in interface io.openlineage.spark.shade.extension.v1.InputDatasetWithFacets

Returns the OpenLineage.InputDatasetInputFacetsBuilder for building input dataset facets.

getInputFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

Returns the OpenLineage.InputDatasetInputFacetsBuilder for building input dataset input facets.

getInputs(String, OpenLineage) - Method in interface io.openlineage.spark.shade.extension.v1.InputLineageNode

Gets input dataset read by this LogicalPlans node

getLineageDatasetIdentifier(String, OpenLineage) - Method in interface io.openlineage.spark.shade.extension.v1.LineageRelation

Returns a DatasetIdentifier containing the namespace and name of the dataset for lineage tracking purposes.

getLineageDatasetIdentifier(String, OpenLineage, Object, Object) - Method in interface io.openlineage.spark.shade.extension.v1.LineageRelationProvider

Returns a DatasetIdentifier containing the namespace and name of the dataset for lineage tracking purposes.

getNode() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

Returns the node in the LogicalPlan from which the input dataset is extracted.

getNode() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

Returns the node in the LogicalPlan from which the output dataset is extracted.

getOutputFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

Returns the OpenLineage.OutputDatasetOutputFacetsBuilder for building output dataset facets.

getOutputFacetsBuilder() - Method in interface io.openlineage.spark.shade.extension.v1.OutputDatasetWithFacets

Returns the OpenLineage.OutputDatasetOutputFacetsBuilder for building output dataset facets.

getOutputFacetsBuilder() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

Returns the OpenLineage.OutputDatasetOutputFacetsBuilder for building output dataset facets.

getOutputs(String, OpenLineage) - Method in interface io.openlineage.spark.shade.extension.v1.OutputLineageNode

Gets output dataset read by this LogicalPlans node

H

hashCode() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

hashCode() - Method in class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

hashCode() - Method in class io.openlineage.spark.shade.extension.v1.OlExprId

hashCode() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

hashCode() - Method in class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

I

InputDatasetWithDelegate - Class in io.openlineage.spark.shade.extension.v1

Represents an input dataset associated with a node in a LogicalPlan.

InputDatasetWithDelegate(Object, OpenLineage.DatasetFacetsBuilder, OpenLineage.InputDatasetInputFacetsBuilder) - Constructor for class io.openlineage.spark.shade.extension.v1.InputDatasetWithDelegate

Constructs a new InputDatasetWithDelegate.

InputDatasetWithFacets - Interface in io.openlineage.spark.shade.extension.v1

Interface representing an input dataset with associated facets (metadata).

InputDatasetWithIdentifier - Class in io.openlineage.spark.shade.extension.v1

Represents an input dataset with an associated DatasetIdentifier containing the dataset's namespace and name.

InputDatasetWithIdentifier(DatasetIdentifier, OpenLineage.DatasetFacetsBuilder, OpenLineage.InputDatasetInputFacetsBuilder) - Constructor for class io.openlineage.spark.shade.extension.v1.InputDatasetWithIdentifier

Constructs a new InputDatasetWithIdentifier.

InputLineageNode - Interface in io.openlineage.spark.shade.extension.v1

Interface to be implemented for LogicalPlan nodes to extract lineage information about input datasets.

io.openlineage.spark.shade.extension.v1 - package io.openlineage.spark.shade.extension.v1

io.openlineage.spark.shade.extension.v1.lifecycle.plan - package io.openlineage.spark.shade.extension.v1.lifecycle.plan

isDefinedAt(Object) - Method in class io.openlineage.spark.shade.extension.v1.lifecycle.plan.SparkOpenLineageExtensionVisitor

Determines if the given lineageNode is of a type that this visitor can process.

L

LineageRelation - Interface in io.openlineage.spark.shade.extension.v1

Interface to be implemented by extension classes that extend org.apache.spark.sql.sources.BaseRelation.

LineageRelationProvider - Interface in io.openlineage.spark.shade.extension.v1

Interface for classes implementing org.apache.spark.sql.sources.RelationProvider.

O

OlExprId - Class in io.openlineage.spark.shade.extension.v1

A class to hold a reference to Spark's ExprId without introducing a dependency on the Spark library.

OlExprId(Long) - Constructor for class io.openlineage.spark.shade.extension.v1.OlExprId

Constructs a new OlExprId with the specified expression identifier.

OutputDatasetWithDelegate - Class in io.openlineage.spark.shade.extension.v1

Represents an output dataset associated with a node in a LogicalPlan.

OutputDatasetWithDelegate(Object, OpenLineage.DatasetFacetsBuilder, OpenLineage.OutputDatasetOutputFacetsBuilder) - Constructor for class io.openlineage.spark.shade.extension.v1.OutputDatasetWithDelegate

Constructs a new OutputDatasetWithDelegate.

OutputDatasetWithFacets - Interface in io.openlineage.spark.shade.extension.v1

Interface representing an output dataset with associated facets (metadata).

OutputDatasetWithIdentifier - Class in io.openlineage.spark.shade.extension.v1

Represents an output dataset associated with an identifier that includes the dataset's namespace and name.

OutputDatasetWithIdentifier(DatasetIdentifier, OpenLineage.DatasetFacetsBuilder, OpenLineage.OutputDatasetOutputFacetsBuilder) - Constructor for class io.openlineage.spark.shade.extension.v1.OutputDatasetWithIdentifier

Constructs a new OutputDatasetWithIdentifier.

OutputLineageNode - Interface in io.openlineage.spark.shade.extension.v1

Interface to be implemented for LogicalPlan nodes to extract lineage information about output datasets.

S

SparkOpenLineageExtensionVisitor - Class in io.openlineage.spark.shade.extension.v1.lifecycle.plan

This class serves as a visitor that wraps method calls for handling input and output lineage in Spark jobs, as defined in the OpenLineage-Spark extension.

SparkOpenLineageExtensionVisitor() - Constructor for class io.openlineage.spark.shade.extension.v1.lifecycle.plan.SparkOpenLineageExtensionVisitor

A E G H I L O S
All Classes and Interfaces|All Packages