Packages

package proto

Type Members

  1. final class AddArtifactsRequest extends GeneratedMessageV3 with AddArtifactsRequestOrBuilder

    Request to transfer client-local artifacts.
    

    Request to transfer client-local artifacts.
    

    Protobuf type spark.connect.AddArtifactsRequest

  2. trait AddArtifactsRequestOrBuilder extends MessageOrBuilder
  3. final class AddArtifactsResponse extends GeneratedMessageV3 with AddArtifactsResponseOrBuilder

    Response to adding an artifact. Contains relevant metadata to verify successful transfer of
    artifact(s).
    

    Response to adding an artifact. Contains relevant metadata to verify successful transfer of
    artifact(s).
    

    Protobuf type spark.connect.AddArtifactsResponse

  4. trait AddArtifactsResponseOrBuilder extends MessageOrBuilder
  5. final class Aggregate extends GeneratedMessageV3 with AggregateOrBuilder

    Relation of type [[Aggregate]].
    

    Relation of type [[Aggregate]].
    

    Protobuf type spark.connect.Aggregate

  6. trait AggregateOrBuilder extends MessageOrBuilder
  7. final class AnalyzePlanRequest extends GeneratedMessageV3 with AnalyzePlanRequestOrBuilder

    Request to perform plan analyze, optionally to explain the plan.
    

    Request to perform plan analyze, optionally to explain the plan.
    

    Protobuf type spark.connect.AnalyzePlanRequest

  8. trait AnalyzePlanRequestOrBuilder extends MessageOrBuilder
  9. final class AnalyzePlanResponse extends GeneratedMessageV3 with AnalyzePlanResponseOrBuilder

    Response to performing analysis of the query. Contains relevant metadata to be able to
    reason about the performance.
    

    Response to performing analysis of the query. Contains relevant metadata to be able to
    reason about the performance.
    

    Protobuf type spark.connect.AnalyzePlanResponse

  10. trait AnalyzePlanResponseOrBuilder extends MessageOrBuilder
  11. final class Base extends AnyRef
  12. final class CacheTable extends GeneratedMessageV3 with CacheTableOrBuilder

    See `spark.catalog.cacheTable`
    

    See `spark.catalog.cacheTable`
    

    Protobuf type spark.connect.CacheTable

  13. trait CacheTableOrBuilder extends MessageOrBuilder
  14. final class Catalog extends GeneratedMessageV3 with CatalogOrBuilder

    Catalog messages are marked as unstable.
    

    Catalog messages are marked as unstable.
    

    Protobuf type spark.connect.Catalog

  15. trait CatalogOrBuilder extends MessageOrBuilder
  16. final class CatalogOuterClass extends AnyRef
  17. final class ClearCache extends GeneratedMessageV3 with ClearCacheOrBuilder

    See `spark.catalog.clearCache`
    

    See `spark.catalog.clearCache`
    

    Protobuf type spark.connect.ClearCache

  18. trait ClearCacheOrBuilder extends MessageOrBuilder
  19. final class CoGroupMap extends GeneratedMessageV3 with CoGroupMapOrBuilder

    Protobuf type spark.connect.CoGroupMap

  20. trait CoGroupMapOrBuilder extends MessageOrBuilder
  21. final class CollectMetrics extends GeneratedMessageV3 with CollectMetricsOrBuilder

    Collect arbitrary (named) metrics from a dataset.
    

    Collect arbitrary (named) metrics from a dataset.
    

    Protobuf type spark.connect.CollectMetrics

  22. trait CollectMetricsOrBuilder extends MessageOrBuilder
  23. final class Command extends GeneratedMessageV3 with CommandOrBuilder

    A [[Command]] is an operation that is executed by the server that does not directly consume or
    produce a relational result.
    

    A [[Command]] is an operation that is executed by the server that does not directly consume or
    produce a relational result.
    

    Protobuf type spark.connect.Command

  24. trait CommandOrBuilder extends MessageOrBuilder
  25. final class Commands extends AnyRef
  26. final class Common extends AnyRef
  27. final class CommonInlineUserDefinedFunction extends GeneratedMessageV3 with CommonInlineUserDefinedFunctionOrBuilder

    Protobuf type spark.connect.CommonInlineUserDefinedFunction

  28. trait CommonInlineUserDefinedFunctionOrBuilder extends MessageOrBuilder
  29. final class ConfigRequest extends GeneratedMessageV3 with ConfigRequestOrBuilder

    Request to update or fetch the configurations.
    

    Request to update or fetch the configurations.
    

    Protobuf type spark.connect.ConfigRequest

  30. trait ConfigRequestOrBuilder extends MessageOrBuilder
  31. final class ConfigResponse extends GeneratedMessageV3 with ConfigResponseOrBuilder

    Response to the config request.
    

    Response to the config request.
    

    Protobuf type spark.connect.ConfigResponse

  32. trait ConfigResponseOrBuilder extends MessageOrBuilder
  33. final class CreateDataFrameViewCommand extends GeneratedMessageV3 with CreateDataFrameViewCommandOrBuilder

    A command that can create DataFrame global temp view or local temp view.
    

    A command that can create DataFrame global temp view or local temp view.
    

    Protobuf type spark.connect.CreateDataFrameViewCommand

  34. trait CreateDataFrameViewCommandOrBuilder extends MessageOrBuilder
  35. final class CreateExternalTable extends GeneratedMessageV3 with CreateExternalTableOrBuilder

    See `spark.catalog.createExternalTable`
    

    See `spark.catalog.createExternalTable`
    

    Protobuf type spark.connect.CreateExternalTable

  36. trait CreateExternalTableOrBuilder extends MessageOrBuilder
  37. final class CreateTable extends GeneratedMessageV3 with CreateTableOrBuilder

    See `spark.catalog.createTable`
    

    See `spark.catalog.createTable`
    

    Protobuf type spark.connect.CreateTable

  38. trait CreateTableOrBuilder extends MessageOrBuilder
  39. final class CurrentCatalog extends GeneratedMessageV3 with CurrentCatalogOrBuilder

    See `spark.catalog.currentCatalog`
    

    See `spark.catalog.currentCatalog`
    

    Protobuf type spark.connect.CurrentCatalog

  40. trait CurrentCatalogOrBuilder extends MessageOrBuilder
  41. final class CurrentDatabase extends GeneratedMessageV3 with CurrentDatabaseOrBuilder

    See `spark.catalog.currentDatabase`
    

    See `spark.catalog.currentDatabase`
    

    Protobuf type spark.connect.CurrentDatabase

  42. trait CurrentDatabaseOrBuilder extends MessageOrBuilder
  43. final class DataType extends GeneratedMessageV3 with DataTypeOrBuilder

    This message describes the logical [[DataType]] of something. It does not carry the value
    itself but only describes it.
    

    This message describes the logical [[DataType]] of something. It does not carry the value
    itself but only describes it.
    

    Protobuf type spark.connect.DataType

  44. trait DataTypeOrBuilder extends MessageOrBuilder
  45. final class DatabaseExists extends GeneratedMessageV3 with DatabaseExistsOrBuilder

    See `spark.catalog.databaseExists`
    

    See `spark.catalog.databaseExists`
    

    Protobuf type spark.connect.DatabaseExists

  46. trait DatabaseExistsOrBuilder extends MessageOrBuilder
  47. final class Deduplicate extends GeneratedMessageV3 with DeduplicateOrBuilder

    Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only
    the subset of columns or all the columns.
    

    Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only
    the subset of columns or all the columns.
    

    Protobuf type spark.connect.Deduplicate

  48. trait DeduplicateOrBuilder extends MessageOrBuilder
  49. final class Drop extends GeneratedMessageV3 with DropOrBuilder

    Drop specified columns.
    

    Drop specified columns.
    

    Protobuf type spark.connect.Drop

  50. final class DropGlobalTempView extends GeneratedMessageV3 with DropGlobalTempViewOrBuilder

    See `spark.catalog.dropGlobalTempView`
    

    See `spark.catalog.dropGlobalTempView`
    

    Protobuf type spark.connect.DropGlobalTempView

  51. trait DropGlobalTempViewOrBuilder extends MessageOrBuilder
  52. trait DropOrBuilder extends MessageOrBuilder
  53. final class DropTempView extends GeneratedMessageV3 with DropTempViewOrBuilder

    See `spark.catalog.dropTempView`
    

    See `spark.catalog.dropTempView`
    

    Protobuf type spark.connect.DropTempView

  54. trait DropTempViewOrBuilder extends MessageOrBuilder
  55. final class ExamplePluginCommand extends GeneratedMessageV3 with ExamplePluginCommandOrBuilder

    Protobuf type spark.connect.ExamplePluginCommand

  56. trait ExamplePluginCommandOrBuilder extends MessageOrBuilder
  57. final class ExamplePluginExpression extends GeneratedMessageV3 with ExamplePluginExpressionOrBuilder

    Protobuf type spark.connect.ExamplePluginExpression

  58. trait ExamplePluginExpressionOrBuilder extends MessageOrBuilder
  59. final class ExamplePluginRelation extends GeneratedMessageV3 with ExamplePluginRelationOrBuilder

    Protobuf type spark.connect.ExamplePluginRelation

  60. trait ExamplePluginRelationOrBuilder extends MessageOrBuilder
  61. final class ExamplePlugins extends AnyRef
  62. final class ExecutePlanRequest extends GeneratedMessageV3 with ExecutePlanRequestOrBuilder

    A request to be executed by the service.
    

    A request to be executed by the service.
    

    Protobuf type spark.connect.ExecutePlanRequest

  63. trait ExecutePlanRequestOrBuilder extends MessageOrBuilder
  64. final class ExecutePlanResponse extends GeneratedMessageV3 with ExecutePlanResponseOrBuilder

    The response of a query, can be one or more for each request. Responses belonging to the
    same input query, carry the same `session_id`.
    

    The response of a query, can be one or more for each request. Responses belonging to the
    same input query, carry the same `session_id`.
    

    Protobuf type spark.connect.ExecutePlanResponse

  65. trait ExecutePlanResponseOrBuilder extends MessageOrBuilder
  66. final class Expression extends GeneratedMessageV3 with ExpressionOrBuilder

    Expression used to refer to fields, functions and similar. This can be used everywhere
    expressions in SQL appear.
    

    Expression used to refer to fields, functions and similar. This can be used everywhere
    expressions in SQL appear.
    

    Protobuf type spark.connect.Expression

  67. trait ExpressionOrBuilder extends MessageOrBuilder
  68. final class Expressions extends AnyRef
  69. final class Filter extends GeneratedMessageV3 with FilterOrBuilder

    Relation that applies a boolean expression `condition` on each row of `input` to produce
    the output result.
    

    Relation that applies a boolean expression `condition` on each row of `input` to produce
    the output result.
    

    Protobuf type spark.connect.Filter

  70. trait FilterOrBuilder extends MessageOrBuilder
  71. final class FunctionExists extends GeneratedMessageV3 with FunctionExistsOrBuilder

    See `spark.catalog.functionExists`
    

    See `spark.catalog.functionExists`
    

    Protobuf type spark.connect.FunctionExists

  72. trait FunctionExistsOrBuilder extends MessageOrBuilder
  73. final class GetDatabase extends GeneratedMessageV3 with GetDatabaseOrBuilder

    See `spark.catalog.getDatabase`
    

    See `spark.catalog.getDatabase`
    

    Protobuf type spark.connect.GetDatabase

  74. trait GetDatabaseOrBuilder extends MessageOrBuilder
  75. final class GetFunction extends GeneratedMessageV3 with GetFunctionOrBuilder

    See `spark.catalog.getFunction`
    

    See `spark.catalog.getFunction`
    

    Protobuf type spark.connect.GetFunction

  76. trait GetFunctionOrBuilder extends MessageOrBuilder
  77. final class GetTable extends GeneratedMessageV3 with GetTableOrBuilder

    See `spark.catalog.getTable`
    

    See `spark.catalog.getTable`
    

    Protobuf type spark.connect.GetTable

  78. trait GetTableOrBuilder extends MessageOrBuilder
  79. final class GroupMap extends GeneratedMessageV3 with GroupMapOrBuilder

    Protobuf type spark.connect.GroupMap

  80. trait GroupMapOrBuilder extends MessageOrBuilder
  81. final class Hint extends GeneratedMessageV3 with HintOrBuilder

    Specify a hint over a relation. Hint should have a name and optional parameters.
    

    Specify a hint over a relation. Hint should have a name and optional parameters.
    

    Protobuf type spark.connect.Hint

  82. trait HintOrBuilder extends MessageOrBuilder
  83. final class IsCached extends GeneratedMessageV3 with IsCachedOrBuilder

    See `spark.catalog.isCached`
    

    See `spark.catalog.isCached`
    

    Protobuf type spark.connect.IsCached

  84. trait IsCachedOrBuilder extends MessageOrBuilder
  85. final class JavaUDF extends GeneratedMessageV3 with JavaUDFOrBuilder

    Protobuf type spark.connect.JavaUDF

  86. trait JavaUDFOrBuilder extends MessageOrBuilder
  87. final class Join extends GeneratedMessageV3 with JoinOrBuilder

    Relation of type [[Join]].
    `left` and `right` must be present.
    

    Relation of type [[Join]].
    `left` and `right` must be present.
    

    Protobuf type spark.connect.Join

  88. trait JoinOrBuilder extends MessageOrBuilder
  89. final class KeyValue extends GeneratedMessageV3 with KeyValueOrBuilder

    The key-value pair for the config request and response.
    

    The key-value pair for the config request and response.
    

    Protobuf type spark.connect.KeyValue

  90. trait KeyValueOrBuilder extends MessageOrBuilder
  91. final class Limit extends GeneratedMessageV3 with LimitOrBuilder

    Relation of type [[Limit]] that is used to `limit` rows from the input relation.
    

    Relation of type [[Limit]] that is used to `limit` rows from the input relation.
    

    Protobuf type spark.connect.Limit

  92. trait LimitOrBuilder extends MessageOrBuilder
  93. final class ListCatalogs extends GeneratedMessageV3 with ListCatalogsOrBuilder

    See `spark.catalog.listCatalogs`
    

    See `spark.catalog.listCatalogs`
    

    Protobuf type spark.connect.ListCatalogs

  94. trait ListCatalogsOrBuilder extends MessageOrBuilder
  95. final class ListColumns extends GeneratedMessageV3 with ListColumnsOrBuilder

    See `spark.catalog.listColumns`
    

    See `spark.catalog.listColumns`
    

    Protobuf type spark.connect.ListColumns

  96. trait ListColumnsOrBuilder extends MessageOrBuilder
  97. final class ListDatabases extends GeneratedMessageV3 with ListDatabasesOrBuilder

    See `spark.catalog.listDatabases`
    

    See `spark.catalog.listDatabases`
    

    Protobuf type spark.connect.ListDatabases

  98. trait ListDatabasesOrBuilder extends MessageOrBuilder
  99. final class ListFunctions extends GeneratedMessageV3 with ListFunctionsOrBuilder

    See `spark.catalog.listFunctions`
    

    See `spark.catalog.listFunctions`
    

    Protobuf type spark.connect.ListFunctions

  100. trait ListFunctionsOrBuilder extends MessageOrBuilder
  101. final class ListTables extends GeneratedMessageV3 with ListTablesOrBuilder

    See `spark.catalog.listTables`
    

    See `spark.catalog.listTables`
    

    Protobuf type spark.connect.ListTables

  102. trait ListTablesOrBuilder extends MessageOrBuilder
  103. final class LocalRelation extends GeneratedMessageV3 with LocalRelationOrBuilder

    A relation that does not need to be qualified by name.
    

    A relation that does not need to be qualified by name.
    

    Protobuf type spark.connect.LocalRelation

  104. trait LocalRelationOrBuilder extends MessageOrBuilder
  105. final class MapPartitions extends GeneratedMessageV3 with MapPartitionsOrBuilder

    Protobuf type spark.connect.MapPartitions

  106. trait MapPartitionsOrBuilder extends MessageOrBuilder
  107. final class NADrop extends GeneratedMessageV3 with NADropOrBuilder

    Drop rows containing null values.
    It will invoke 'Dataset.na.drop' (same as 'DataFrameNaFunctions.drop') to compute the results.
    

    Drop rows containing null values.
    It will invoke 'Dataset.na.drop' (same as 'DataFrameNaFunctions.drop') to compute the results.
    

    Protobuf type spark.connect.NADrop

  108. trait NADropOrBuilder extends MessageOrBuilder
  109. final class NAFill extends GeneratedMessageV3 with NAFillOrBuilder

    Replaces null values.
    It will invoke 'Dataset.na.fill' (same as 'DataFrameNaFunctions.fill') to compute the results.
    Following 3 parameter combinations are supported:
     1, 'values' only contains 1 item, 'cols' is empty:
       replaces null values in all type-compatible columns.
     2, 'values' only contains 1 item, 'cols' is not empty:
       replaces null values in specified columns.
     3, 'values' contains more than 1 items, then 'cols' is required to have the same length:
       replaces each specified column with corresponding value.
    

    Replaces null values.
    It will invoke 'Dataset.na.fill' (same as 'DataFrameNaFunctions.fill') to compute the results.
    Following 3 parameter combinations are supported:
     1, 'values' only contains 1 item, 'cols' is empty:
       replaces null values in all type-compatible columns.
     2, 'values' only contains 1 item, 'cols' is not empty:
       replaces null values in specified columns.
     3, 'values' contains more than 1 items, then 'cols' is required to have the same length:
       replaces each specified column with corresponding value.
    

    Protobuf type spark.connect.NAFill

  110. trait NAFillOrBuilder extends MessageOrBuilder
  111. final class NAReplace extends GeneratedMessageV3 with NAReplaceOrBuilder

    Replaces old values with the corresponding values.
    It will invoke 'Dataset.na.replace' (same as 'DataFrameNaFunctions.replace')
    to compute the results.
    

    Replaces old values with the corresponding values.
    It will invoke 'Dataset.na.replace' (same as 'DataFrameNaFunctions.replace')
    to compute the results.
    

    Protobuf type spark.connect.NAReplace

  112. trait NAReplaceOrBuilder extends MessageOrBuilder
  113. final class Offset extends GeneratedMessageV3 with OffsetOrBuilder

    Relation of type [[Offset]] that is used to read rows staring from the `offset` on
    the input relation.
    

    Relation of type [[Offset]] that is used to read rows staring from the `offset` on
    the input relation.
    

    Protobuf type spark.connect.Offset

  114. trait OffsetOrBuilder extends MessageOrBuilder
  115. final class Parse extends GeneratedMessageV3 with ParseOrBuilder

    Protobuf type spark.connect.Parse

  116. trait ParseOrBuilder extends MessageOrBuilder
  117. final class Plan extends GeneratedMessageV3 with PlanOrBuilder

    A [[Plan]] is the structure that carries the runtime information for the execution from the
    client to the server. A [[Plan]] can either be of the type [[Relation]] which is a reference
    to the underlying logical plan or it can be of the [[Command]] type that is used to execute
    commands on the server.
    

    A [[Plan]] is the structure that carries the runtime information for the execution from the
    client to the server. A [[Plan]] can either be of the type [[Relation]] which is a reference
    to the underlying logical plan or it can be of the [[Command]] type that is used to execute
    commands on the server.
    

    Protobuf type spark.connect.Plan

  118. trait PlanOrBuilder extends MessageOrBuilder
  119. final class Project extends GeneratedMessageV3 with ProjectOrBuilder

    Projection of a bag of expressions for a given input relation.
    The input relation must be specified.
    The projected expression can be an arbitrary expression.
    

    Projection of a bag of expressions for a given input relation.
    The input relation must be specified.
    The projected expression can be an arbitrary expression.
    

    Protobuf type spark.connect.Project

  120. trait ProjectOrBuilder extends MessageOrBuilder
  121. final class PythonUDF extends GeneratedMessageV3 with PythonUDFOrBuilder

    Protobuf type spark.connect.PythonUDF

  122. trait PythonUDFOrBuilder extends MessageOrBuilder
  123. final class Range extends GeneratedMessageV3 with RangeOrBuilder

    Relation of type [[Range]] that generates a sequence of integers.
    

    Relation of type [[Range]] that generates a sequence of integers.
    

    Protobuf type spark.connect.Range

  124. trait RangeOrBuilder extends MessageOrBuilder
  125. final class Read extends GeneratedMessageV3 with ReadOrBuilder

    Relation that reads from a file / table or other data source. Does not have additional
    inputs.
    

    Relation that reads from a file / table or other data source. Does not have additional
    inputs.
    

    Protobuf type spark.connect.Read

  126. trait ReadOrBuilder extends MessageOrBuilder
  127. final class RecoverPartitions extends GeneratedMessageV3 with RecoverPartitionsOrBuilder

    See `spark.catalog.recoverPartitions`
    

    See `spark.catalog.recoverPartitions`
    

    Protobuf type spark.connect.RecoverPartitions

  128. trait RecoverPartitionsOrBuilder extends MessageOrBuilder
  129. final class RefreshByPath extends GeneratedMessageV3 with RefreshByPathOrBuilder

    See `spark.catalog.refreshByPath`
    

    See `spark.catalog.refreshByPath`
    

    Protobuf type spark.connect.RefreshByPath

  130. trait RefreshByPathOrBuilder extends MessageOrBuilder
  131. final class RefreshTable extends GeneratedMessageV3 with RefreshTableOrBuilder

    See `spark.catalog.refreshTable`
    

    See `spark.catalog.refreshTable`
    

    Protobuf type spark.connect.RefreshTable

  132. trait RefreshTableOrBuilder extends MessageOrBuilder
  133. final class Relation extends GeneratedMessageV3 with RelationOrBuilder

    The main [[Relation]] type. Fundamentally, a relation is a typed container
    that has exactly one explicit relation type set.
    When adding new relation types, they have to be registered here.
    

    The main [[Relation]] type. Fundamentally, a relation is a typed container
    that has exactly one explicit relation type set.
    When adding new relation types, they have to be registered here.
    

    Protobuf type spark.connect.Relation

  134. final class RelationCommon extends GeneratedMessageV3 with RelationCommonOrBuilder

    Common metadata of all relations.
    

    Common metadata of all relations.
    

    Protobuf type spark.connect.RelationCommon

  135. trait RelationCommonOrBuilder extends MessageOrBuilder
  136. trait RelationOrBuilder extends MessageOrBuilder
  137. final class Relations extends AnyRef
  138. final class Repartition extends GeneratedMessageV3 with RepartitionOrBuilder

    Relation repartition.
    

    Relation repartition.
    

    Protobuf type spark.connect.Repartition

  139. final class RepartitionByExpression extends GeneratedMessageV3 with RepartitionByExpressionOrBuilder

    Protobuf type spark.connect.RepartitionByExpression

  140. trait RepartitionByExpressionOrBuilder extends MessageOrBuilder
  141. trait RepartitionOrBuilder extends MessageOrBuilder
  142. final class SQL extends GeneratedMessageV3 with SQLOrBuilder

    Relation that uses a SQL query to generate the output.
    

    Relation that uses a SQL query to generate the output.
    

    Protobuf type spark.connect.SQL

  143. trait SQLOrBuilder extends MessageOrBuilder
  144. final class Sample extends GeneratedMessageV3 with SampleOrBuilder

    Relation of type [[Sample]] that samples a fraction of the dataset.
    

    Relation of type [[Sample]] that samples a fraction of the dataset.
    

    Protobuf type spark.connect.Sample

  145. trait SampleOrBuilder extends MessageOrBuilder
  146. final class ScalarScalaUDF extends GeneratedMessageV3 with ScalarScalaUDFOrBuilder

    Protobuf type spark.connect.ScalarScalaUDF

  147. trait ScalarScalaUDFOrBuilder extends MessageOrBuilder
  148. final class SetCurrentCatalog extends GeneratedMessageV3 with SetCurrentCatalogOrBuilder

    See `spark.catalog.setCurrentCatalog`
    

    See `spark.catalog.setCurrentCatalog`
    

    Protobuf type spark.connect.SetCurrentCatalog

  149. trait SetCurrentCatalogOrBuilder extends MessageOrBuilder
  150. final class SetCurrentDatabase extends GeneratedMessageV3 with SetCurrentDatabaseOrBuilder

    See `spark.catalog.setCurrentDatabase`
    

    See `spark.catalog.setCurrentDatabase`
    

    Protobuf type spark.connect.SetCurrentDatabase

  151. trait SetCurrentDatabaseOrBuilder extends MessageOrBuilder
  152. final class SetOperation extends GeneratedMessageV3 with SetOperationOrBuilder

    Relation of type [[SetOperation]]
    

    Relation of type [[SetOperation]]
    

    Protobuf type spark.connect.SetOperation

  153. trait SetOperationOrBuilder extends MessageOrBuilder
  154. final class ShowString extends GeneratedMessageV3 with ShowStringOrBuilder

    Compose the string representing rows for output.
    It will invoke 'Dataset.showString' to compute the results.
    

    Compose the string representing rows for output.
    It will invoke 'Dataset.showString' to compute the results.
    

    Protobuf type spark.connect.ShowString

  155. trait ShowStringOrBuilder extends MessageOrBuilder
  156. final class Sort extends GeneratedMessageV3 with SortOrBuilder

    Relation of type [[Sort]].
    

    Relation of type [[Sort]].
    

    Protobuf type spark.connect.Sort

  157. trait SortOrBuilder extends MessageOrBuilder
  158. final class SparkConnectServiceGrpc extends AnyRef

    Main interface for the SparkConnect service.
    

    Main interface for the SparkConnect service.
    

    Annotations
    @Generated() @GrpcGenerated()
  159. final class SqlCommand extends GeneratedMessageV3 with SqlCommandOrBuilder

    A SQL Command is used to trigger the eager evaluation of SQL commands in Spark.
    When the SQL provide as part of the message is a command it will be immediately evaluated
    and the result will be collected and returned as part of a LocalRelation. If the result is
    not a command, the operation will simply return a SQL Relation. This allows the client to be
    almost oblivious to the server-side behavior.
    

    A SQL Command is used to trigger the eager evaluation of SQL commands in Spark.
    When the SQL provide as part of the message is a command it will be immediately evaluated
    and the result will be collected and returned as part of a LocalRelation. If the result is
    not a command, the operation will simply return a SQL Relation. This allows the client to be
    almost oblivious to the server-side behavior.
    

    Protobuf type spark.connect.SqlCommand

  160. trait SqlCommandOrBuilder extends MessageOrBuilder
  161. final class StatApproxQuantile extends GeneratedMessageV3 with StatApproxQuantileOrBuilder

    Calculates the approximate quantiles of numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.approxQuantile' (same as 'StatFunctions.approxQuantile')
    to compute the results.
    

    Calculates the approximate quantiles of numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.approxQuantile' (same as 'StatFunctions.approxQuantile')
    to compute the results.
    

    Protobuf type spark.connect.StatApproxQuantile

  162. trait StatApproxQuantileOrBuilder extends MessageOrBuilder
  163. final class StatCorr extends GeneratedMessageV3 with StatCorrOrBuilder

    Calculates the correlation of two columns of a DataFrame. Currently only supports the Pearson
    Correlation Coefficient. It will invoke 'Dataset.stat.corr' (same as
    'StatFunctions.pearsonCorrelation') to compute the results.
    

    Calculates the correlation of two columns of a DataFrame. Currently only supports the Pearson
    Correlation Coefficient. It will invoke 'Dataset.stat.corr' (same as
    'StatFunctions.pearsonCorrelation') to compute the results.
    

    Protobuf type spark.connect.StatCorr

  164. trait StatCorrOrBuilder extends MessageOrBuilder
  165. final class StatCov extends GeneratedMessageV3 with StatCovOrBuilder

    Calculate the sample covariance of two numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.cov' (same as 'StatFunctions.calculateCov') to compute the results.
    

    Calculate the sample covariance of two numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.cov' (same as 'StatFunctions.calculateCov') to compute the results.
    

    Protobuf type spark.connect.StatCov

  166. trait StatCovOrBuilder extends MessageOrBuilder
  167. final class StatCrosstab extends GeneratedMessageV3 with StatCrosstabOrBuilder

    Computes a pair-wise frequency table of the given columns. Also known as a contingency table.
    It will invoke 'Dataset.stat.crosstab' (same as 'StatFunctions.crossTabulate')
    to compute the results.
    

    Computes a pair-wise frequency table of the given columns. Also known as a contingency table.
    It will invoke 'Dataset.stat.crosstab' (same as 'StatFunctions.crossTabulate')
    to compute the results.
    

    Protobuf type spark.connect.StatCrosstab

  168. trait StatCrosstabOrBuilder extends MessageOrBuilder
  169. final class StatDescribe extends GeneratedMessageV3 with StatDescribeOrBuilder

    Computes basic statistics for numeric and string columns, including count, mean, stddev, min,
    and max. If no columns are given, this function computes statistics for all numerical or
    string columns.
    

    Computes basic statistics for numeric and string columns, including count, mean, stddev, min,
    and max. If no columns are given, this function computes statistics for all numerical or
    string columns.
    

    Protobuf type spark.connect.StatDescribe

  170. trait StatDescribeOrBuilder extends MessageOrBuilder
  171. final class StatFreqItems extends GeneratedMessageV3 with StatFreqItemsOrBuilder

    Finding frequent items for columns, possibly with false positives.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Finding frequent items for columns, possibly with false positives.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Protobuf type spark.connect.StatFreqItems

  172. trait StatFreqItemsOrBuilder extends MessageOrBuilder
  173. final class StatSampleBy extends GeneratedMessageV3 with StatSampleByOrBuilder

    Returns a stratified sample without replacement based on the fraction
    given on each stratum.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Returns a stratified sample without replacement based on the fraction
    given on each stratum.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Protobuf type spark.connect.StatSampleBy

  174. trait StatSampleByOrBuilder extends MessageOrBuilder
  175. final class StatSummary extends GeneratedMessageV3 with StatSummaryOrBuilder

    Computes specified statistics for numeric and string columns.
    It will invoke 'Dataset.summary' (same as 'StatFunctions.summary')
    to compute the results.
    

    Computes specified statistics for numeric and string columns.
    It will invoke 'Dataset.summary' (same as 'StatFunctions.summary')
    to compute the results.
    

    Protobuf type spark.connect.StatSummary

  176. trait StatSummaryOrBuilder extends MessageOrBuilder
  177. final class StorageLevel extends GeneratedMessageV3 with StorageLevelOrBuilder

    StorageLevel for persisting Datasets/Tables.
    

    StorageLevel for persisting Datasets/Tables.
    

    Protobuf type spark.connect.StorageLevel

  178. trait StorageLevelOrBuilder extends MessageOrBuilder
  179. final class SubqueryAlias extends GeneratedMessageV3 with SubqueryAliasOrBuilder

    Relation alias.
    

    Relation alias.
    

    Protobuf type spark.connect.SubqueryAlias

  180. trait SubqueryAliasOrBuilder extends MessageOrBuilder
  181. final class TableExists extends GeneratedMessageV3 with TableExistsOrBuilder

    See `spark.catalog.tableExists`
    

    See `spark.catalog.tableExists`
    

    Protobuf type spark.connect.TableExists

  182. trait TableExistsOrBuilder extends MessageOrBuilder
  183. final class Tail extends GeneratedMessageV3 with TailOrBuilder

    Relation of type [[Tail]] that is used to fetch `limit` rows from the last of the input relation.
    

    Relation of type [[Tail]] that is used to fetch `limit` rows from the last of the input relation.
    

    Protobuf type spark.connect.Tail

  184. trait TailOrBuilder extends MessageOrBuilder
  185. final class ToDF extends GeneratedMessageV3 with ToDFOrBuilder

    Rename columns on the input relation by the same length of names.
    

    Rename columns on the input relation by the same length of names.
    

    Protobuf type spark.connect.ToDF

  186. trait ToDFOrBuilder extends MessageOrBuilder
  187. final class ToSchema extends GeneratedMessageV3 with ToSchemaOrBuilder

    Protobuf type spark.connect.ToSchema

  188. trait ToSchemaOrBuilder extends MessageOrBuilder
  189. final class Types extends AnyRef
  190. final class UncacheTable extends GeneratedMessageV3 with UncacheTableOrBuilder

    See `spark.catalog.uncacheTable`
    

    See `spark.catalog.uncacheTable`
    

    Protobuf type spark.connect.UncacheTable

  191. trait UncacheTableOrBuilder extends MessageOrBuilder
  192. final class Unknown extends GeneratedMessageV3 with UnknownOrBuilder

    Used for testing purposes only.
    

    Used for testing purposes only.
    

    Protobuf type spark.connect.Unknown

  193. trait UnknownOrBuilder extends MessageOrBuilder
  194. final class Unpivot extends GeneratedMessageV3 with UnpivotOrBuilder

    Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set.
    

    Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set.
    

    Protobuf type spark.connect.Unpivot

  195. trait UnpivotOrBuilder extends MessageOrBuilder
  196. final class UserContext extends GeneratedMessageV3 with UserContextOrBuilder

    User Context is used to refer to one particular user session that is executing
    queries in the backend.
    

    User Context is used to refer to one particular user session that is executing
    queries in the backend.
    

    Protobuf type spark.connect.UserContext

  197. trait UserContextOrBuilder extends MessageOrBuilder
  198. final class WithColumns extends GeneratedMessageV3 with WithColumnsOrBuilder

    Adding columns or replacing the existing columns that have the same names.
    

    Adding columns or replacing the existing columns that have the same names.
    

    Protobuf type spark.connect.WithColumns

  199. trait WithColumnsOrBuilder extends MessageOrBuilder
  200. final class WithColumnsRenamed extends GeneratedMessageV3 with WithColumnsRenamedOrBuilder

    Rename columns on the input relation by a map with name to name mapping.
    

    Rename columns on the input relation by a map with name to name mapping.
    

    Protobuf type spark.connect.WithColumnsRenamed

  201. trait WithColumnsRenamedOrBuilder extends MessageOrBuilder
  202. final class WriteOperation extends GeneratedMessageV3 with WriteOperationOrBuilder

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    Protobuf type spark.connect.WriteOperation

  203. trait WriteOperationOrBuilder extends MessageOrBuilder
  204. final class WriteOperationV2 extends GeneratedMessageV3 with WriteOperationV2OrBuilder

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    Protobuf type spark.connect.WriteOperationV2

  205. trait WriteOperationV2OrBuilder extends MessageOrBuilder

Ungrouped