Packages

c

org.apache.spark.sql.internal

ReadOnlySQLConf

class ReadOnlySQLConf extends SQLConf

A readonly SQLConf that will be created by tasks running at the executor side. It reads the configs from the local properties which are propagated from driver to executors.

Linear Supertypes
SQLConf, SqlApiConf, Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadOnlySQLConf
  2. SQLConf
  3. SqlApiConf
  4. Logging
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ReadOnlySQLConf(context: TaskContext)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def adaptiveExecutionEnabled: Boolean
    Definition Classes
    SQLConf
  5. def adaptiveExecutionLogLevel: String
    Definition Classes
    SQLConf
  6. def addSingleFileInAddFile: Boolean
    Definition Classes
    SQLConf
  7. def advancedPartitionPredicatePushdownEnabled: Boolean
    Definition Classes
    SQLConf
  8. def allowAutoGeneratedAliasForView: Boolean
    Definition Classes
    SQLConf
  9. def allowNegativeScaleOfDecimalEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  10. def allowNonEmptyLocationInCTAS: Boolean
    Definition Classes
    SQLConf
  11. def allowStarWithSingleTableIdentifierInCount: Boolean
    Definition Classes
    SQLConf
  12. def allowsTempViewCreationWithMultipleNameparts: Boolean
    Definition Classes
    SQLConf
  13. def analyzerMaxIterations: Int

    ************************ Spark SQL Params/Hints *******************

    ************************ Spark SQL Params/Hints *******************

    Definition Classes
    SQLConf
  14. def ansiEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  15. def ansiRelationPrecedence: Boolean
    Definition Classes
    SQLConf
  16. def arrowLocalRelationThreshold: Long
    Definition Classes
    SQLConf
  17. def arrowMaxRecordsPerBatch: Int
    Definition Classes
    SQLConf
  18. def arrowPySparkEnabled: Boolean
    Definition Classes
    SQLConf
  19. def arrowPySparkFallbackEnabled: Boolean
    Definition Classes
    SQLConf
  20. def arrowPySparkSelfDestructEnabled: Boolean
    Definition Classes
    SQLConf
  21. def arrowSafeTypeConversion: Boolean
    Definition Classes
    SQLConf
  22. def arrowSparkREnabled: Boolean
    Definition Classes
    SQLConf
  23. def arrowUseLargeVarTypes: Boolean
    Definition Classes
    SQLConf
  24. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  25. def autoBroadcastJoinThreshold: Long
    Definition Classes
    SQLConf
  26. def autoBucketedScanEnabled: Boolean
    Definition Classes
    SQLConf
  27. def autoSizeUpdateEnabled: Boolean
    Definition Classes
    SQLConf
  28. def avroCompressionCodec: String
    Definition Classes
    SQLConf
  29. def avroDeflateLevel: Int
    Definition Classes
    SQLConf
  30. def avroFilterPushDown: Boolean
    Definition Classes
    SQLConf
  31. def broadcastHashJoinOutputPartitioningExpandLimit: Int
    Definition Classes
    SQLConf
  32. def broadcastTimeout: Long
    Definition Classes
    SQLConf
  33. def bucketingEnabled: Boolean
    Definition Classes
    SQLConf
  34. def bucketingMaxBuckets: Int
    Definition Classes
    SQLConf
  35. def cacheVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  36. def cartesianProductExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  37. def cartesianProductExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  38. def caseSensitiveAnalysis: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  39. def caseSensitiveInferenceMode: SQLConf.HiveCaseSensitiveInferenceMode.Value
    Definition Classes
    SQLConf
  40. def castDatetimeToString: Boolean
    Definition Classes
    SQLConf
  41. def cboEnabled: Boolean
    Definition Classes
    SQLConf
  42. def charVarcharAsString: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  43. def checkpointLocation: Option[String]
    Definition Classes
    SQLConf
  44. def checkpointRenamedFileCheck: Boolean
    Definition Classes
    SQLConf
  45. def chunkBase64StringEnabled: Boolean
    Definition Classes
    SQLConf
  46. def clear(): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  47. def cliPrintHeader: Boolean
    Definition Classes
    SQLConf
  48. def clone(): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf → AnyRef
  49. def coalesceBucketsInJoinEnabled: Boolean
    Definition Classes
    SQLConf
  50. def coalesceBucketsInJoinMaxBucketRatio: Int
    Definition Classes
    SQLConf
  51. def coalesceShufflePartitionsEnabled: Boolean
    Definition Classes
    SQLConf
  52. def codegenCacheMaxEntries: Int
    Definition Classes
    SQLConf
  53. def codegenComments: Boolean
    Definition Classes
    SQLConf
  54. def codegenFactoryMode: String
    Definition Classes
    SQLConf
  55. def codegenFallback: Boolean
    Definition Classes
    SQLConf
  56. def codegenSplitAggregateFunc: Boolean
    Definition Classes
    SQLConf
  57. def columnBatchSize: Int
    Definition Classes
    SQLConf
  58. def columnNameOfCorruptRecord: String
    Definition Classes
    SQLConf
  59. def concatBinaryAsString: Boolean
    Definition Classes
    SQLConf
  60. def constraintPropagationEnabled: Boolean
    Definition Classes
    SQLConf
  61. def contains(key: String): Boolean

    Return whether a given key is set in this SQLConf.

    Return whether a given key is set in this SQLConf.

    Definition Classes
    SQLConf
  62. def continuousStreamingEpochBacklogQueueSize: Int
    Definition Classes
    SQLConf
  63. def continuousStreamingExecutorPollIntervalMs: Long
    Definition Classes
    SQLConf
  64. def continuousStreamingExecutorQueueSize: Int
    Definition Classes
    SQLConf
  65. def convertCTAS: Boolean
    Definition Classes
    SQLConf
  66. def copy(entries: (ConfigEntry[_], Any)*): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf
  67. def crossJoinEnabled: Boolean
    Definition Classes
    SQLConf
  68. def csvColumnPruning: Boolean
    Definition Classes
    SQLConf
  69. def csvEnableDateTimeParsingFallback: Option[Boolean]
    Definition Classes
    SQLConf
  70. def csvExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  71. def csvFilterPushDown: Boolean
    Definition Classes
    SQLConf
  72. def dataFramePivotMaxValues: Int
    Definition Classes
    SQLConf
  73. def dataFrameRetainGroupColumns: Boolean
    Definition Classes
    SQLConf
  74. def dataFrameSelfJoinAutoResolveAmbiguity: Boolean
    Definition Classes
    SQLConf
  75. def datetimeJava8ApiEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  76. def decimalOperationsAllowPrecisionLoss: Boolean
    Definition Classes
    SQLConf
  77. def decorrelateInnerQueryEnabled: Boolean
    Definition Classes
    SQLConf
  78. def defaultColumnAllowedProviders: String
    Definition Classes
    SQLConf
  79. def defaultDataSourceName: String
    Definition Classes
    SQLConf
  80. def defaultDatabase: String
    Definition Classes
    SQLConf
  81. def defaultNumShufflePartitions: Int
    Definition Classes
    SQLConf
  82. def defaultSizeInBytes: Long
    Definition Classes
    SQLConf
  83. def disabledJdbcConnectionProviders: String
    Definition Classes
    SQLConf
  84. def disabledV2StreamingMicroBatchReaders: String
    Definition Classes
    SQLConf
  85. def disabledV2StreamingWriters: String
    Definition Classes
    SQLConf
  86. def doubleQuotedIdentifiers: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  87. def dynamicPartitionPruningEnabled: Boolean
    Definition Classes
    SQLConf
  88. def dynamicPartitionPruningFallbackFilterRatio: Double
    Definition Classes
    SQLConf
  89. def dynamicPartitionPruningReuseBroadcastOnly: Boolean
    Definition Classes
    SQLConf
  90. def dynamicPartitionPruningUseStats: Boolean
    Definition Classes
    SQLConf
  91. def eltOutputAsString: Boolean
    Definition Classes
    SQLConf
  92. def enableDefaultColumns: Boolean
    Definition Classes
    SQLConf
  93. def enableRadixSort: Boolean
    Definition Classes
    SQLConf
  94. def enableTwoLevelAggMap: Boolean
    Definition Classes
    SQLConf
  95. def enableVectorizedHashMap: Boolean
    Definition Classes
    SQLConf
  96. def enforceReservedKeywords: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  97. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  98. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  99. def errorMessageFormat: ErrorMessageFormat.Value
    Definition Classes
    SQLConf
  100. def escapedStringLiterals: Boolean
    Definition Classes
    SQLConf
  101. def exchangeReuseEnabled: Boolean
    Definition Classes
    SQLConf
  102. def exponentLiteralAsDecimalEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  103. def fallBackToHdfsForStatsEnabled: Boolean
    Definition Classes
    SQLConf
  104. def fastFailFileFormatOutput: Boolean
    Definition Classes
    SQLConf
  105. def fastHashAggregateRowMaxCapacityBit: Int
    Definition Classes
    SQLConf
  106. def fetchShuffleBlocksInBatch: Boolean
    Definition Classes
    SQLConf
  107. def fileCommitProtocolClass: String
    Definition Classes
    SQLConf
  108. def fileCompressionFactor: Double
    Definition Classes
    SQLConf
  109. def fileSinkLogCleanupDelay: Long
    Definition Classes
    SQLConf
  110. def fileSinkLogCompactInterval: Int
    Definition Classes
    SQLConf
  111. def fileSinkLogDeletion: Boolean
    Definition Classes
    SQLConf
  112. def fileSourceLogCleanupDelay: Long
    Definition Classes
    SQLConf
  113. def fileSourceLogCompactInterval: Int
    Definition Classes
    SQLConf
  114. def fileSourceLogDeletion: Boolean
    Definition Classes
    SQLConf
  115. def fileStreamSinkMetadataIgnored: Boolean
    Definition Classes
    SQLConf
  116. def filesMaxPartitionBytes: Long
    Definition Classes
    SQLConf
  117. def filesMaxPartitionNum: Option[Int]
    Definition Classes
    SQLConf
  118. def filesMinPartitionNum: Option[Int]
    Definition Classes
    SQLConf
  119. def filesOpenCostInBytes: Long
    Definition Classes
    SQLConf
  120. def filesourcePartitionFileCacheSize: Long
    Definition Classes
    SQLConf
  121. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  122. def gatherFastStats: Boolean
    Definition Classes
    SQLConf
  123. def getAllConfs: Map[String, String]

    Return all the configuration properties that have been set (i.e.

    Return all the configuration properties that have been set (i.e. not the default). This creates a new copy of the config properties in the form of a Map.

    Definition Classes
    SQLConf
  124. def getAllDefinedConfs: Seq[(String, String, String, String)]

    Return all the configuration definitions that have been defined in SQLConf.

    Return all the configuration definitions that have been defined in SQLConf. Each definition contains key, defaultValue and doc.

    Definition Classes
    SQLConf
  125. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  126. def getConf[T](entry: OptionalConfigEntry[T]): Option[T]

    Return the value of an optional Spark SQL configuration property for the given key.

    Return the value of an optional Spark SQL configuration property for the given key. If the key is not set yet, returns None.

    Definition Classes
    SQLConf
  127. def getConf[T](entry: ConfigEntry[T]): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue in ConfigEntry.

    Definition Classes
    SQLConf
  128. def getConf[T](entry: ConfigEntry[T], defaultValue: T): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue. This is useful when defaultValue in ConfigEntry is not the desired one.

    Definition Classes
    SQLConf
  129. def getConfString(key: String, defaultValue: String): String

    Return the string value of Spark SQL configuration property for the given key.

    Return the string value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue.

    Definition Classes
    SQLConf
  130. def getConfString(key: String): String

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key.

    Definition Classes
    SQLConf
    Annotations
    @throws( "if key is not set" )
  131. def groupByAliases: Boolean
    Definition Classes
    SQLConf
  132. def groupByOrdinal: Boolean
    Definition Classes
    SQLConf
  133. def groupingIdWithAppendedUserGroupByEnabled: Boolean
    Definition Classes
    SQLConf
  134. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  135. def hintErrorHandler: HintErrorHandler

    Returns the error handler for handling hint errors.

    Returns the error handler for handling hint errors.

    Definition Classes
    SQLConf
  136. def histogramEnabled: Boolean
    Definition Classes
    SQLConf
  137. def histogramNumBins: Int
    Definition Classes
    SQLConf
  138. def histogramNumericPropagateInputType: Boolean
    Definition Classes
    SQLConf
  139. def hiveThriftServerSingleSession: Boolean
    Definition Classes
    SQLConf
  140. def hugeMethodLimit: Int
    Definition Classes
    SQLConf
  141. def ignoreCorruptFiles: Boolean
    Definition Classes
    SQLConf
  142. def ignoreDataLocality: Boolean
    Definition Classes
    SQLConf
  143. def ignoreMissingFiles: Boolean
    Definition Classes
    SQLConf
  144. def ignoreMissingParquetFieldId: Boolean
    Definition Classes
    SQLConf
  145. def inMemoryPartitionPruning: Boolean
    Definition Classes
    SQLConf
  146. def inMemoryTableScanStatisticsEnabled: Boolean
    Definition Classes
    SQLConf
  147. def inferDictAsStruct: Boolean
    Definition Classes
    SQLConf
  148. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  149. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  150. def integerGroupingIdEnabled: Boolean
    Definition Classes
    SQLConf
  151. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  152. def isModifiable(key: String): Boolean
    Definition Classes
    SQLConf
  153. def isOrcSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  154. def isParquetBinaryAsString: Boolean
    Definition Classes
    SQLConf
  155. def isParquetINT96AsTimestamp: Boolean
    Definition Classes
    SQLConf
  156. def isParquetINT96TimestampConversion: Boolean
    Definition Classes
    SQLConf
  157. def isParquetSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  158. def isParquetSchemaRespectSummaries: Boolean
    Definition Classes
    SQLConf
  159. def isReplEagerEvalEnabled: Boolean
    Definition Classes
    SQLConf
  160. def isStateSchemaCheckEnabled: Boolean
    Definition Classes
    SQLConf
  161. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  162. def isUnsupportedOperationCheckEnabled: Boolean
    Definition Classes
    SQLConf
  163. def joinReorderCardWeight: Double
    Definition Classes
    SQLConf
  164. def joinReorderDPStarFilter: Boolean
    Definition Classes
    SQLConf
  165. def joinReorderDPThreshold: Int
    Definition Classes
    SQLConf
  166. def joinReorderEnabled: Boolean
    Definition Classes
    SQLConf
  167. def jsonEnableDateTimeParsingFallback: Option[Boolean]
    Definition Classes
    SQLConf
  168. def jsonEnablePartialResults: Boolean
    Definition Classes
    SQLConf
  169. def jsonExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  170. def jsonFilterPushDown: Boolean
    Definition Classes
    SQLConf
  171. def jsonGeneratorIgnoreNullFields: Boolean
    Definition Classes
    SQLConf
  172. def jsonWriteNullIfWithDefaultValue: Boolean
    Definition Classes
    SQLConf
  173. def legacyInferArrayTypeFromFirstElement: Boolean
    Definition Classes
    SQLConf
  174. def legacyIntervalEnabled: Boolean
    Definition Classes
    SQLConf
  175. def legacyMsSqlServerNumericMappingEnabled: Boolean
    Definition Classes
    SQLConf
  176. def legacyNegativeIndexInArrayInsert: Boolean
    Definition Classes
    SQLConf
  177. def legacyParquetNanosAsLong: Boolean
    Definition Classes
    SQLConf
  178. def legacyPathOptionBehavior: Boolean
    Definition Classes
    SQLConf
  179. def legacySizeOfNull: Boolean
    Definition Classes
    SQLConf
  180. def legacyStatisticalAggregate: Boolean
    Definition Classes
    SQLConf
  181. def legacyTimeParserPolicy: LegacyBehaviorPolicy.Value
    Definition Classes
    SQLConf → SqlApiConf
  182. def limitInitialNumPartitions: Int
    Definition Classes
    SQLConf
  183. def limitScaleUpFactor: Int
    Definition Classes
    SQLConf
  184. def literalPickMinimumPrecision: Boolean
    Definition Classes
    SQLConf
  185. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  186. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  187. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  188. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  189. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  190. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  191. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  192. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  193. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  194. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  195. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  196. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  197. def loggingMaxLinesForCodegen: Int
    Definition Classes
    SQLConf
  198. def manageFilesourcePartitions: Boolean
    Definition Classes
    SQLConf
  199. def maxBatchesToRetainInMemory: Int
    Definition Classes
    SQLConf
  200. def maxConcurrentOutputFileWriters: Int
    Definition Classes
    SQLConf
  201. def maxMetadataStringLength: Int
    Definition Classes
    SQLConf
  202. def maxNestedViewDepth: Int
    Definition Classes
    SQLConf
  203. def maxPlanStringLength: Int
    Definition Classes
    SQLConf
  204. def maxRecordsPerFile: Long
    Definition Classes
    SQLConf
  205. def maxToStringFields: Int
    Definition Classes
    SQLConf → SqlApiConf
  206. def metadataCacheTTL: Long
    Definition Classes
    SQLConf
  207. def metastoreDropPartitionsByName: Boolean
    Definition Classes
    SQLConf
  208. def metastorePartitionPruning: Boolean
    Definition Classes
    SQLConf
  209. def metastorePartitionPruningFallbackOnException: Boolean
    Definition Classes
    SQLConf
  210. def metastorePartitionPruningFastFallback: Boolean
    Definition Classes
    SQLConf
  211. def metastorePartitionPruningInSetThreshold: Int
    Definition Classes
    SQLConf
  212. def methodSplitThreshold: Int
    Definition Classes
    SQLConf
  213. def minBatchesToRetain: Int
    Definition Classes
    SQLConf
  214. def nameNonStructGroupingKeyAsValue: Boolean
    Definition Classes
    SQLConf
  215. def ndvMaxError: Double
    Definition Classes
    SQLConf
  216. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  217. def nestedPruningOnExpressions: Boolean
    Definition Classes
    SQLConf
  218. def nestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  219. def nonEmptyPartitionRatioForBroadcastJoin: Double
    Definition Classes
    SQLConf
  220. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  221. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  222. def numShufflePartitions: Int
    Definition Classes
    SQLConf
  223. def objectAggSortBasedFallbackThreshold: Int
    Definition Classes
    SQLConf
  224. def offHeapColumnVectorEnabled: Boolean
    Definition Classes
    SQLConf
  225. def optimizeNullAwareAntiJoin: Boolean
    Definition Classes
    SQLConf
  226. def optimizerExcludedRules: Option[String]
    Definition Classes
    SQLConf
  227. def optimizerInSetConversionThreshold: Int
    Definition Classes
    SQLConf
  228. def optimizerInSetSwitchThreshold: Int
    Definition Classes
    SQLConf
  229. def optimizerMaxIterations: Int
    Definition Classes
    SQLConf
  230. def optimizerMetadataOnly: Boolean
    Definition Classes
    SQLConf
  231. def orcAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  232. def orcCompressionCodec: String
    Definition Classes
    SQLConf
  233. def orcFilterPushDown: Boolean
    Definition Classes
    SQLConf
  234. def orcVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  235. def orcVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  236. def orcVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  237. def orcVectorizedWriterBatchSize: Int
    Definition Classes
    SQLConf
  238. def orderByOrdinal: Boolean
    Definition Classes
    SQLConf
  239. def pandasGroupedMapAssignColumnsByName: Boolean
    Definition Classes
    SQLConf
  240. def pandasStructHandlingMode: String
    Definition Classes
    SQLConf
  241. def pandasUDFBufferSize: Int
    Definition Classes
    SQLConf
  242. def parallelFileListingInStatsComputation: Boolean
    Definition Classes
    SQLConf
  243. def parallelPartitionDiscoveryParallelism: Int
    Definition Classes
    SQLConf
  244. def parallelPartitionDiscoveryThreshold: Int
    Definition Classes
    SQLConf
  245. def parquetAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  246. def parquetCompressionCodec: String
    Definition Classes
    SQLConf
  247. def parquetFieldIdReadEnabled: Boolean
    Definition Classes
    SQLConf
  248. def parquetFieldIdWriteEnabled: Boolean
    Definition Classes
    SQLConf
  249. def parquetFilterPushDown: Boolean
    Definition Classes
    SQLConf
  250. def parquetFilterPushDownDate: Boolean
    Definition Classes
    SQLConf
  251. def parquetFilterPushDownDecimal: Boolean
    Definition Classes
    SQLConf
  252. def parquetFilterPushDownInFilterThreshold: Int
    Definition Classes
    SQLConf
  253. def parquetFilterPushDownStringPredicate: Boolean
    Definition Classes
    SQLConf
  254. def parquetFilterPushDownTimestamp: Boolean
    Definition Classes
    SQLConf
  255. def parquetInferTimestampNTZEnabled: Boolean
    Definition Classes
    SQLConf
  256. def parquetOutputCommitterClass: String
    Definition Classes
    SQLConf
  257. def parquetOutputTimestampType: SQLConf.ParquetOutputTimestampType.Value
    Definition Classes
    SQLConf
  258. def parquetRecordFilterEnabled: Boolean
    Definition Classes
    SQLConf
  259. def parquetVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  260. def parquetVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  261. def parquetVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  262. def partitionColumnTypeInferenceEnabled: Boolean
    Definition Classes
    SQLConf
  263. def partitionOverwriteMode: SQLConf.PartitionOverwriteMode.Value
    Definition Classes
    SQLConf
  264. def percentileAccuracy: Int
    Definition Classes
    SQLConf
  265. def planChangeBatches: Option[String]
    Definition Classes
    SQLConf
  266. def planChangeLogLevel: String
    Definition Classes
    SQLConf
  267. def planChangeRules: Option[String]
    Definition Classes
    SQLConf
  268. def planStatsEnabled: Boolean
    Definition Classes
    SQLConf
  269. def plannedWriteEnabled: Boolean
    Definition Classes
    SQLConf
  270. def preferSortMergeJoin: Boolean
    Definition Classes
    SQLConf
  271. def pysparkJVMStacktraceEnabled: Boolean
    Definition Classes
    SQLConf
  272. def pysparkSimplifiedTraceback: Boolean
    Definition Classes
    SQLConf
  273. def pysparkWorkerPythonExecutable: Option[String]
    Definition Classes
    SQLConf
  274. def rangeExchangeSampleSizePerPartition: Int
    Definition Classes
    SQLConf
  275. def readSideCharPadding: Boolean
    Definition Classes
    SQLConf
  276. val reader: ConfigReader
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  277. def redactOptions[K, V](options: Seq[(K, V)]): Seq[(K, V)]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  278. def redactOptions[K, V](options: Map[K, V]): Map[K, V]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  279. def replEagerEvalMaxNumRows: Int
    Definition Classes
    SQLConf
  280. def replEagerEvalTruncate: Int
    Definition Classes
    SQLConf
  281. def replaceDatabricksSparkAvroEnabled: Boolean
    Definition Classes
    SQLConf
  282. def replaceExceptWithFilter: Boolean
    Definition Classes
    SQLConf
  283. def resolver: Resolver

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Definition Classes
    SQLConf
  284. def runSQLonFile: Boolean
    Definition Classes
    SQLConf
  285. def runtimeFilterBloomFilterEnabled: Boolean
    Definition Classes
    SQLConf
  286. def runtimeFilterCreationSideThreshold: Long
    Definition Classes
    SQLConf
  287. def runtimeFilterSemiJoinReductionEnabled: Boolean
    Definition Classes
    SQLConf
  288. def runtimeRowLevelOperationGroupFilterEnabled: Boolean
    Definition Classes
    SQLConf
  289. def serializerNestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  290. def sessionLocalTimeZone: String
    Definition Classes
    SQLConf → SqlApiConf
  291. def sessionWindowBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  292. def sessionWindowBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  293. def setCommandRejectsSparkCoreConfs: Boolean
    Definition Classes
    SQLConf
  294. def setConf[T](entry: ConfigEntry[T], value: T): Unit

    Set the given Spark SQL configuration property.

    Set the given Spark SQL configuration property.

    Definition Classes
    SQLConf
  295. def setConf(props: Properties): Unit

    Set Spark SQL configuration properties.

    Set Spark SQL configuration properties.

    Definition Classes
    SQLConf
  296. def setConfString(key: String, value: String): Unit

    Set the given Spark SQL configuration property using a string value.

    Set the given Spark SQL configuration property using a string value.

    Definition Classes
    SQLConf
  297. def setConfWithCheck(key: String, value: String): Unit
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  298. def setOpsPrecedenceEnforced: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  299. val settings: Map[String, String]
    Definition Classes
    ReadOnlySQLConf → SQLConf
  300. def sortBeforeRepartition: Boolean
    Definition Classes
    SQLConf
  301. def sortMergeJoinExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  302. def sortMergeJoinExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  303. def starSchemaDetection: Boolean
    Definition Classes
    SQLConf
  304. def starSchemaFTRatio: Double
    Definition Classes
    SQLConf
  305. def stateStoreCompressionCodec: String
    Definition Classes
    SQLConf
  306. def stateStoreFormatValidationEnabled: Boolean
    Definition Classes
    SQLConf
  307. def stateStoreMinDeltasForSnapshot: Int
    Definition Classes
    SQLConf
  308. def stateStoreProviderClass: String
    Definition Classes
    SQLConf
  309. def stateStoreSkipNullsForStreamStreamJoins: Boolean
    Definition Classes
    SQLConf
  310. def statefulOperatorCorrectnessCheckEnabled: Boolean
    Definition Classes
    SQLConf
  311. def storeAnalyzedPlanForView: Boolean
    Definition Classes
    SQLConf
  312. def storeAssignmentPolicy: SQLConf.StoreAssignmentPolicy.Value
    Definition Classes
    SQLConf
  313. def streamingFileCommitProtocolClass: String
    Definition Classes
    SQLConf
  314. def streamingMaintenanceInterval: Long
    Definition Classes
    SQLConf
  315. def streamingMetricsEnabled: Boolean
    Definition Classes
    SQLConf
  316. def streamingNoDataMicroBatchesEnabled: Boolean
    Definition Classes
    SQLConf
  317. def streamingNoDataProgressEventInterval: Long
    Definition Classes
    SQLConf
  318. def streamingPollingDelay: Long
    Definition Classes
    SQLConf
  319. def streamingProgressRetention: Int
    Definition Classes
    SQLConf
  320. def streamingSchemaInference: Boolean
    Definition Classes
    SQLConf
  321. def streamingSessionWindowMergeSessionInLocalPartition: Boolean
    Definition Classes
    SQLConf
  322. def stringRedactionPattern: Option[Regex]
    Definition Classes
    SQLConf
  323. def subexpressionEliminationCacheMaxEntries: Int
    Definition Classes
    SQLConf
  324. def subexpressionEliminationEnabled: Boolean
    Definition Classes
    SQLConf
  325. def subexpressionEliminationSkipForShotcutExpr: Boolean
    Definition Classes
    SQLConf
  326. def subqueryReuseEnabled: Boolean
    Definition Classes
    SQLConf
  327. def supportQuotedRegexColumnName: Boolean
    Definition Classes
    SQLConf
  328. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  329. def tableRelationCacheSize: Int
    Definition Classes
    SQLConf
  330. def timestampType: AtomicType
    Definition Classes
    SQLConf → SqlApiConf
  331. def toString(): String
    Definition Classes
    AnyRef → Any
  332. def topKSortFallbackThreshold: Int
    Definition Classes
    SQLConf
  333. def truncateTableIgnorePermissionAcl: Boolean
    Definition Classes
    SQLConf
  334. def tvfAllowMultipleTableArguments: Boolean
    Definition Classes
    SQLConf
  335. def uiExplainMode: String
    Definition Classes
    SQLConf
  336. def unsetConf(entry: ConfigEntry[_]): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  337. def unsetConf(key: String): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  338. def useCompression: Boolean
    Definition Classes
    SQLConf
  339. def useCurrentSQLConfigsForView: Boolean
    Definition Classes
    SQLConf
  340. def useDeprecatedKafkaOffsetFetching: Boolean
    Definition Classes
    SQLConf
  341. def useNullsForMissingDefaultColumnValues: Boolean
    Definition Classes
    SQLConf
  342. def useObjectHashAggregation: Boolean
    Definition Classes
    SQLConf
  343. def usePartitionEvaluator: Boolean
    Definition Classes
    SQLConf
  344. def useV1Command: Boolean
    Definition Classes
    SQLConf
  345. def v2BucketingEnabled: Boolean
    Definition Classes
    SQLConf
  346. def v2BucketingPartiallyClusteredDistributionEnabled: Boolean
    Definition Classes
    SQLConf
  347. def v2BucketingPushPartValuesEnabled: Boolean
    Definition Classes
    SQLConf
  348. def validatePartitionColumns: Boolean
    Definition Classes
    SQLConf
  349. def variableSubstituteEnabled: Boolean
    Definition Classes
    SQLConf
  350. def verifyPartitionPath: Boolean
    Definition Classes
    SQLConf
  351. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  352. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  353. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  354. def warehousePath: String
    Definition Classes
    SQLConf
  355. def wholeStageEnabled: Boolean
    Definition Classes
    SQLConf
  356. def wholeStageMaxNumFields: Int
    Definition Classes
    SQLConf
  357. def wholeStageSplitConsumeFuncByOperator: Boolean
    Definition Classes
    SQLConf
  358. def wholeStageUseIdInClassName: Boolean
    Definition Classes
    SQLConf
  359. def windowExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  360. def windowExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  361. def windowGroupLimitThreshold: Int
    Definition Classes
    SQLConf
  362. def writeLegacyParquetFormat: Boolean
    Definition Classes
    SQLConf

Inherited from SQLConf

Inherited from SqlApiConf

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped