package connect
Package Members
- package config
- package dsl
A collection of implicit conversions that create a DSL for constructing connect protos.
A collection of implicit conversions that create a DSL for constructing connect protos.
All classes in connect/dsl are considered an internal API to Spark Connect and are subject to change between minor releases.
- package planner
- package plugin
- package service
Type Members
- class SparkConnectPlugin extends SparkPlugin
This is the main entry point for Spark Connect.
This is the main entry point for Spark Connect.
To decouple the build of Spark Connect and its dependencies from the core of Spark, we implement it as a Driver Plugin. To enable Spark Connect, simply make sure that the appropriate JAR is available in the CLASSPATH and the driver plugin is configured to load this class.