Packages

o

org.apache.spark.sql.delta

DeltaErrors

object DeltaErrors extends DocsPath with DeltaLogging

A holder object for Delta errors.

IMPORTANT: Any time you add a test that references the docs, add to the Seq defined in DeltaErrorsSuite so that the doc links that are generated can be verified to work in Azure, docs.databricks.com and docs.delta.io

Linear Supertypes
DeltaLogging, DatabricksLogging, DeltaProgressReporter, Logging, DocsPath, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DeltaErrors
  2. DeltaLogging
  3. DatabricksLogging
  4. DeltaProgressReporter
  5. Logging
  6. DocsPath
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val DeltaSourceIgnoreChangesErrorMessage: String
  5. val DeltaSourceIgnoreDeleteErrorMessage: String
  6. def aggsNotSupportedException(op: String, cond: Expression): Throwable
  7. def alterTableChangeColumnException(oldColumns: String, newColumns: String): Throwable
  8. def alterTableReplaceColumnsException(oldSchema: StructType, newSchema: StructType, reason: String): Throwable
  9. def alterTableSetLocationSchemaMismatchException(original: StructType, destination: StructType): Throwable
  10. def ambiguousPartitionColumnException(columnName: String, colMatches: Seq[StructField]): Throwable
  11. def analysisException(msg: String, line: Option[Int] = None, startPosition: Option[Int] = None, plan: Option[LogicalPlan] = None, cause: Option[Throwable] = None): AnalysisException
  12. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  13. def assertValidCallingFunction(): Unit
    Definition Classes
    DocsPath
  14. def baseDocsPath(spark: SparkSession): String
  15. def baseDocsPath(conf: SparkConf): String

    The URL for the base path of Delta's docs.

    The URL for the base path of Delta's docs. When changing this path, ensure that the new path works with the error messages below.

    Attributes
    protected
    Definition Classes
    DocsPath
  16. def bloomFilterCreateOnNonExistingColumnsException(unknownColumns: Seq[String]): Throwable
  17. def bloomFilterDropOnNonExistingColumnsException(unknownColumns: Seq[String]): Throwable
  18. def bloomFilterDropOnNonIndexedColumnException(name: String): Throwable
  19. def bloomFilterInvalidParameterValueException(message: String): Throwable
  20. def bloomFilterMultipleConfForSingleColumnException(name: String): Throwable
  21. def bloomFilterOnColumnTypeNotSupportedException(name: String, dataType: DataType): Throwable
  22. def bloomFilterOnNestedColumnNotSupportedException(name: String): Throwable
  23. def bloomFilterOnPartitionColumnNotSupportedException(name: String): Throwable
  24. def cannotInsertIntoColumn(tableName: String, source: String, target: String, targetType: String): Throwable
  25. def castPartitionValueException(partitionValue: String, dataType: DataType): Throwable
  26. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  27. def columnNotInSchemaException(column: String, schema: StructType): Throwable
  28. def commitAlreadyExistsException(version: Long, logPath: Path): Throwable
  29. def concurrentModificationExceptionMsg(sparkConf: SparkConf, baseMessage: String, commit: Option[CommitInfo]): String
  30. def convertMetastoreMetadataMismatchException(tableProperties: Map[String, String], deltaConfiguration: Map[String, String]): Throwable
  31. def convertNonParquetTablesException(ident: TableIdentifier, sourceName: String): Throwable
  32. def createExternalTableWithoutLogException(path: Path, tableName: String, spark: SparkSession): Throwable
  33. def createExternalTableWithoutSchemaException(path: Path, tableName: String, spark: SparkSession): Throwable
  34. def createManagedTableWithoutSchemaException(tableName: String, spark: SparkSession): Throwable
  35. def createTableWithDifferentPartitioningException(path: Path, specifiedColumns: Seq[String], existingColumns: Seq[String]): Throwable
  36. def createTableWithDifferentPropertiesException(path: Path, specifiedProperties: Map[String, String], existingProperties: Map[String, String]): Throwable
  37. def createTableWithDifferentSchemaException(path: Path, specifiedSchema: StructType, existingSchema: StructType, diffs: Seq[String]): Throwable
  38. def deltaFileNotFoundHint(faqPath: String, path: String): String

    File not found hint for Delta, replacing the normal one which is inapplicable.

    File not found hint for Delta, replacing the normal one which is inapplicable.

    Note that we must pass in the docAddress as a string, because the config is not available on executors where this method is called.

  39. def deltaLogAlreadyExistsException(path: String): Throwable
  40. def deltaVersionsNotContiguousException(deltaVersions: Seq[Long]): Throwable
  41. def describeViewHistory: Throwable
  42. def emptyDataException: Throwable
  43. def emptyDirectoryException(directory: String): Throwable
  44. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  45. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  46. def errorsWithDocsLinks: Seq[String]

    List of error function names for all errors that have URLs.

    List of error function names for all errors that have URLs. When adding your error to this list remember to also add it to the list of errors in DeltaErrorsSuite

    Definition Classes
    DocsPath
    Note

    add your error to DeltaErrorsSuiteBase after adding it to this list so that the url can be tested

  47. val faqRelativePath: String
  48. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  49. def formatColumn(colName: String): String
  50. def formatColumnList(colNames: Seq[String]): String
  51. def formatSchema(schema: StructType): String
  52. def generateDocsLink(conf: SparkConf, relativePath: String, skipValidation: Boolean = false): String

    Get the link to the docs for the given relativePath.

    Get the link to the docs for the given relativePath. Validates that the error generating the link is added to docsLinks.

    relativePath

    the relative path after the base url to access.

    skipValidation

    whether to validate that the function generating the link is in the whitelist

    returns

    The entire URL of the documentation link

    Definition Classes
    DocsPath
  53. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  54. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  55. def ignoreStreamingUpdatesAndDeletesWarning(spark: SparkSession): String
  56. def illegalDeltaOptionException(name: String, input: String, explain: String): Throwable
  57. def illegalUsageException(option: String, operation: String): Throwable
  58. def inSubqueryNotSupportedException(operation: String): Throwable
  59. def incorrectLogStoreImplementationException(sparkConf: SparkConf, cause: Throwable): Throwable
  60. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  61. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  62. def invalidColumnName(name: String): Throwable
  63. def invalidPartitionColumn(e: AnalysisException): Throwable
  64. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  65. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  66. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  67. def logConsole(line: String): Unit
    Definition Classes
    DatabricksLogging
  68. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  69. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  70. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  71. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  72. def logFileNotFoundException(path: Path, version: Long, metadata: Metadata): Throwable
  73. def logFileNotFoundExceptionForStreamingSource(e: FileNotFoundException): Throwable
  74. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  75. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  76. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  77. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  78. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  79. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  80. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  81. def missingPartFilesException(version: Long, ae: Exception): Throwable
  82. def missingProviderForConvertException(path: String): Throwable
  83. def missingTableIdentifierException(operationName: String): Throwable
  84. def modifyAppendOnlyTableException: Throwable
  85. def multiColumnInPredicateNotSupportedException(operation: String): Throwable
  86. def multipleLoadPathsException(paths: Seq[String]): Throwable
  87. def multipleSourceRowMatchingTargetRowInMergeException(spark: SparkSession): Throwable
  88. def multipleTimeTravelSyntaxUsed: Throwable
  89. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  90. def nestedFieldNotSupported(operation: String, field: String): Throwable
  91. def nestedSubqueryNotSupportedException(operation: String): Throwable
  92. def noHistoryFound(logPath: Path): Throwable
  93. def noReproducibleHistoryFound(logPath: Path): Throwable
  94. def nonDeterministicNotSupportedException(op: String, cond: Expression): Throwable
  95. def nonPartitionColumnAbsentException(colsDropped: Boolean): Throwable
  96. def notADeltaSourceException(command: String, plan: Option[LogicalPlan] = None): Throwable
  97. def notADeltaTableException(operation: String): Throwable
  98. def notADeltaTableException(operation: String, deltaTableIdentifier: DeltaTableIdentifier): Throwable
  99. def notADeltaTableException(deltaTableIdentifier: DeltaTableIdentifier): Throwable
  100. def notEnoughColumnsInInsert(table: String, query: Int, target: Int, nestedField: Option[String] = None): Throwable
  101. def notNullInvariantException(invariant: Invariant): Throwable
  102. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  103. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  104. def operationNotSupportedException(operation: String): Throwable
  105. def operationNotSupportedException(operation: String, tableIdentifier: TableIdentifier): Throwable
  106. def outputModeNotSupportedException(dataSource: String, outputMode: OutputMode): Throwable
  107. def partitionColumnNotFoundException(colName: String, schema: Seq[Attribute]): Throwable
  108. def partitionPathInvolvesNonPartitionColumnException(badColumns: Seq[String], fragment: String): Throwable
  109. def partitionPathParseException(fragment: String): Throwable
  110. def pathAlreadyExistsException(path: Path): Throwable
  111. def pathNotExistsException(path: String): Throwable
  112. def pathNotSpecifiedException: Throwable
  113. def postCommitHookFailedException(failedHook: PostCommitHook, failedOnCommitVersion: Long, extraErrorMessage: String, error: Throwable): Throwable
  114. def provideOneOfInTimeTravel: Throwable
  115. def recordDeltaEvent(deltaLog: DeltaLog, opType: String, tags: Map[TagDefinition, String] = Map.empty, data: AnyRef = null): Unit

    Used to record the occurrence of a single event or report detailed, operation specific statistics.

    Used to record the occurrence of a single event or report detailed, operation specific statistics.

    Attributes
    protected
    Definition Classes
    DeltaLogging
  116. def recordDeltaOperation[A](deltaLog: DeltaLog, opType: String, tags: Map[TagDefinition, String] = Map.empty)(thunk: ⇒ A): A

    Used to report the duration as well as the success or failure of an operation.

    Used to report the duration as well as the success or failure of an operation.

    Attributes
    protected
    Definition Classes
    DeltaLogging
  117. def recordEvent(metric: MetricDefinition, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, trimBlob: Boolean = true): Unit
    Definition Classes
    DatabricksLogging
  118. def recordOperation[S](opType: OpType, opTarget: String = null, extraTags: Map[TagDefinition, String], isSynchronous: Boolean = true, alwaysRecordStats: Boolean = false, allowAuthTags: Boolean = false, killJvmIfStuck: Boolean = false, outputMetric: MetricDefinition = null, silent: Boolean = true)(thunk: ⇒ S): S
    Definition Classes
    DatabricksLogging
  119. def recordUsage(metric: MetricDefinition, quantity: Double, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, forceSample: Boolean = false, trimBlob: Boolean = true, silent: Boolean = false): Unit
    Definition Classes
    DatabricksLogging
  120. def replaceWhereMismatchException(replaceWhere: String, badPartitions: String): Throwable
  121. def schemaChangedException(oldSchema: StructType, newSchema: StructType): Throwable
  122. def schemaChangedSinceAnalysis(atAnalysis: StructType, latestSchema: StructType): Throwable
  123. def schemaNotProvidedException: Throwable
  124. def schemaNotSetException: Throwable
  125. def setLocationNotSupportedOnPathIdentifiers(): Throwable
  126. def specifySchemaAtReadTimeException: Throwable
  127. def staticPartitionsNotSupportedException: Throwable
  128. def streamWriteNullTypeException: Throwable
  129. def subqueryNotSupportedException(op: String, cond: Expression): Throwable
  130. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  131. def tableNotSupportedException(operation: String): Throwable
  132. def temporallyUnstableInput(userTimestamp: Timestamp, commitTs: Timestamp, timestampString: String, commitVersion: Long): Throwable
  133. def timeTravelNotSupportedException: Throwable
  134. def timestampEarlierThanCommitRetention(userTimestamp: Timestamp, commitTs: Timestamp, timestampString: String): Throwable
  135. def toString(): String
    Definition Classes
    AnyRef → Any
  136. def truncateTablePartitionNotSupportedException: Throwable
  137. def unexpectedDataChangeException(op: String): Throwable
  138. def unexpectedNumPartitionColumnsFromFileNameException(path: String, parsedCols: Seq[String], expectedCols: Seq[String]): Throwable
  139. def unexpectedPartitionColumnFromFileNameException(path: String, parsedCol: String, expectedCol: String): Throwable
  140. def unknownConfigurationKeyException(confKey: String): Throwable
  141. def unrecognizedLogFile(path: Path): Throwable
  142. def unsetNonExistentPropertyException(propertyKey: String, deltaTableIdentifier: DeltaTableIdentifier): Throwable
  143. def unsupportedGenerateModeException(modeName: String): Throwable
  144. def updateNonStructTypeFieldNotSupportedException(col: String, s: DataType): Throwable
  145. def updateSetColumnNotFoundException(col: String, colList: Seq[String]): Throwable
  146. def updateSetConflictException(cols: Seq[String]): Throwable
  147. def useDeltaOnOtherFormatPathException(operation: String, path: String, spark: SparkSession): Throwable
  148. def useOtherFormatOnDeltaPathException(operation: String, deltaRootPath: String, path: String, format: String, spark: SparkSession): Throwable
  149. def vacuumBasePathMissingException(baseDeltaPath: Path): Throwable
  150. def versionNotExistException(userVersion: Long, earliest: Long, latest: Long): Throwable
  151. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  152. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  153. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  154. def withStatusCode[T](statusCode: String, defaultMessage: String, data: Map[String, Any] = Map.empty)(body: ⇒ T): T

    Report a log to indicate some command is running.

    Report a log to indicate some command is running.

    Definition Classes
    DeltaProgressReporter

Inherited from DeltaLogging

Inherited from DatabricksLogging

Inherited from DeltaProgressReporter

Inherited from Logging

Inherited from DocsPath

Inherited from AnyRef

Inherited from Any

Ungrouped