Type Members

1.  case class ExecuteEventsManager(executeHolder: ExecuteHolder, clock: Clock) extends Product with Serializable

   Post request Connect events to @link org.apache.spark.scheduler.LiveListenerBus.

2.  case class ExecuteInfo(request: ExecutePlanRequest, userId: String, sessionId: String, operationId: String, jobTag: String, sparkSessionTags: Set[String], reattachable: Boolean, status: ExecuteStatus, creationTime: Long, lastAttachedRpcTime: Option[Long], closedTime: Option[Long]) extends Product with Serializable

   Information about an ExecuteHolder.

3.  case class ExecuteKey(userId: String, sessionId: String, operationId: String) extends Product with Serializable
4.  sealed abstract class ExecuteStatus extends AnyRef
5.  class LocalPropertiesCleanupInterceptor extends ServerInterceptor

   Interceptor for cleaning up local properties in the SparkContext after gRPC server calls.

6.  class LoggingInterceptor extends ServerInterceptor with Logging

   A gRPC interceptor to log RPC requests and responses.

   A gRPC interceptor to log RPC requests and responses. It logs the protobufs as JSON. Useful for local development. An ID is logged for each RPC so that requests and corresponding responses can be exactly matched.

7.  case class SessionEventsManager(sessionHolder: SessionHolder, clock: Clock) extends Product with Serializable

   Post session Connect events to @link org.apache.spark.scheduler.LiveListenerBus.

8.  case class SessionHolder(userId: String, sessionId: String, session: SparkSession) extends Logging with Product with Serializable

   Object used to hold the Spark Connect session state.

9.  sealed abstract class SessionStatus extends AnyRef
10.  class SparkConnectAddArtifactsHandler extends StreamObserver[AddArtifactsRequest]

    Handles AddArtifactsRequests for the SparkConnectService.

11.  class SparkConnectArtifactStatusesHandler extends Logging
12.  class SparkConnectConfigHandler extends Logging
13.  class SparkConnectExecutePlanHandler extends Logging
14.  class SparkConnectInterruptHandler extends Logging
15.  class SparkConnectReattachExecuteHandler extends Logging
16.  class SparkConnectReleaseExecuteHandler extends Logging
17.  class SparkConnectService extends AsyncService with BindableService with Logging

    The SparkConnectService implementation.

    The SparkConnectService implementation.

    This class implements the service stub from the generated code of GRPC.

18.  case class SparkListenerConnectOperationAnalyzed(jobTag: String, operationId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    The event is sent after a Connect request has been analyzed (@link org.apache.spark.sql.catalyst.QueryPlanningTracker.ANALYSIS).

19.  case class SparkListenerConnectOperationCanceled(jobTag: String, operationId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect request has been canceled.

20.  case class SparkListenerConnectOperationClosed(jobTag: String, operationId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect request has finished executing and results have been sent to client.

21.  case class SparkListenerConnectOperationFailed(jobTag: String, operationId: String, eventTime: Long, errorMessage: String, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect request has failed.

22.  case class SparkListenerConnectOperationFinished(jobTag: String, operationId: String, eventTime: Long, producedRowCount: Option[Long] = None, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect request has finished executing, but prior results have been sent to client.

23.  case class SparkListenerConnectOperationReadyForExecution(jobTag: String, operationId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    The event is sent after a Connect request is ready for execution.

    The event is sent after a Connect request is ready for execution. For eager commands this is after @link org.apache.spark.sql.catalyst.QueryPlanningTracker.ANALYSIS. For other requests it is after \@link org.apache.spark.sql.catalyst.QueryPlanningTracker.PLANNING

24.  case class SparkListenerConnectOperationStarted(jobTag: String, operationId: String, eventTime: Long, sessionId: String, userId: String, userName: String, statementText: String, sparkSessionTags: Set[String], extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after reception of a Connect request (i.e.

    Event sent after reception of a Connect request (i.e. not queued), but prior any analysis or execution.

25.  case class SparkListenerConnectSessionClosed(sessionId: String, userId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect session has been closed.

26.  case class SparkListenerConnectSessionStarted(sessionId: String, userId: String, eventTime: Long, extraTags: Map[String, String] = Map.empty) extends SparkListenerEvent with Product with Serializable

    Event sent after a Connect session has been started.