Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  val PROP_CLUSTERING_COLUMNS: String
5.  def areClusteringColumnsInStatsSchema(snapshot: Snapshot, logicalClusteringColumns: Seq[String]): Boolean

   Returns true if stats will be collected for all clustering columns.

6.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.CloneNotSupportedException]) @native()

8.  def clusteringProvider: String

   The clustering implementation name for AddFile.clusteringProvider

9.  def createDomainMetadata(clusteringColumns: Seq[ClusteringColumn]): DomainMetadata

   Create a DomainMetadata action to store clustering columns.

10.  def deltaAssert(check: => Boolean, name: String, msg: String, deltaLog: DeltaLog = null, data: AnyRef = null, path: Option[Path] = None): Unit

    Helper method to check invariants in Delta code.

    Helper method to check invariants in Delta code. Fails when running in tests, records a delta assertion event and logs a warning otherwise.

    Attributes

    protected

    Definition Classes

    DeltaLogging

11.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

12.  def equals(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef → Any

13.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.Throwable])

14.  final def getClass(): Class[_ <: AnyRef]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

15.  def getClusterBySpecOptional(table: CatalogTable): Option[ClusterBySpec]

    Returns an optional ClusterBySpec from the given CatalogTable.

16.  def getClusteringColumnsAsProperty(maybeClusterBySpec: Option[ClusterBySpec]): Option[(String, String)]

    Extract clustering columns from ClusterBySpec.

    Extract clustering columns from ClusterBySpec.

    maybeClusterBySpec

    optional ClusterBySpec. If it's empty, will return the original properties.

    returns

    an optional pair with clustering columns.

17.  def getClusteringColumnsOptional(snapshot: Snapshot): Option[Seq[ClusteringColumn]]

    Extract ClusteringColumns from a given snapshot.

    Extract ClusteringColumns from a given snapshot. Return None if the clustering domain metadata is missing.

18.  def getClusteringDomainMetadata(snapshot: Snapshot): Seq[DomainMetadata]

    Extract DomainMetadata for storing clustering columns from a given snapshot.

    Extract DomainMetadata for storing clustering columns from a given snapshot. It returns clustering domain metadata if exists. Return empty if the clustering domain metadata is missing.

19.  def getClusteringDomainMetadataForAlterTableClusterBy(newLogicalClusteringColumns: Seq[String], txn: OptimisticTransaction): Seq[DomainMetadata]

    Create new clustering DomainMetadata actions given updated column names for 'ALTER TABLE ...

    Create new clustering DomainMetadata actions given updated column names for 'ALTER TABLE ... CLUSTER BY'.

20.  def getCommonTags(deltaLog: DeltaLog, tahoeId: String): Map[TagDefinition, String]

    Definition Classes

    DeltaLogging

21.  def getDomainMetadataOptional(table: CatalogTable, txn: OptimisticTransaction): Option[DomainMetadata]

    Create a ClusteringMetadataDomain with the given CatalogTable's clustering column property.

22.  def getDomainMetadataOptional(clusterBySpecOpt: Option[ClusterBySpec], txn: OptimisticTransaction): Option[DomainMetadata]

    Create an optional DomainMetadata action to store clustering columns.

23.  def getErrorData(e: Throwable): Map[String, Any]

    Definition Classes

    DeltaLogging

24.  def getLogicalClusteringColumnNames(txn: OptimisticTransaction, actionsToCommit: Seq[Action]): Option[Seq[String]]

    Extract the logical clustering column names from the to-be committed domain metadata action.

    Extract the logical clustering column names from the to-be committed domain metadata action.

    txn

    the transaction being used to commit the actions.

    actionsToCommit

    the actions to be committed.

    returns

    optional logical clustering column names.

25.  def getTableFeatureProperties(existingProperties: Map[String, String]): Map[String, String]

    Returns table feature properties that's required to create a clustered table.

    Returns table feature properties that's required to create a clustered table.

    existingProperties

    Table properties set by the user when creating a clustered table.

26.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

27.  def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Attributes

    protected

    Definition Classes

    Logging

28.  def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Attributes

    protected

    Definition Classes

    Logging

29.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

30.  def isSupported(protocol: Protocol): Boolean

    Returns whether the protocol version supports the Liquid table feature.

31.  def isTraceEnabled(): Boolean

    Attributes

    protected

    Definition Classes

    Logging

32.  def log: Logger

    Attributes

    protected

    Definition Classes

    Logging

33.  def logConsole(line: String): Unit

    Definition Classes

    DatabricksLogging

34.  def logDebug(msg: => String, throwable: Throwable): Unit

    Attributes

    protected

    Definition Classes

    Logging

35.  def logDebug(msg: => String): Unit

    Attributes

    protected

    Definition Classes

    Logging

36.  def logError(msg: => String, throwable: Throwable): Unit

    Attributes

    protected

    Definition Classes

    Logging

37.  def logError(msg: => String): Unit

    Attributes

    protected

    Definition Classes

    Logging

38.  def logInfo(msg: => String, throwable: Throwable): Unit

    Attributes

    protected

    Definition Classes

    Logging

39.  def logInfo(msg: => String): Unit

    Attributes

    protected

    Definition Classes

    Logging

40.  def logName: String

    Attributes

    protected

    Definition Classes

    Logging

41.  def logTrace(msg: => String, throwable: Throwable): Unit

    Attributes

    protected

    Definition Classes

    Logging

42.  def logTrace(msg: => String): Unit

    Attributes

    protected

    Definition Classes

    Logging

43.  def logWarning(msg: => String, throwable: Throwable): Unit

    Attributes

    protected

    Definition Classes

    Logging

44.  def logWarning(msg: => String): Unit

    Attributes

    protected

    Definition Classes

    Logging

45.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

46.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

47.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

48.  def recordDeltaEvent(deltaLog: DeltaLog, opType: String, tags: Map[TagDefinition, String] = Map.empty, data: AnyRef = null, path: Option[Path] = None): Unit

    Used to record the occurrence of a single event or report detailed, operation specific statistics.

    Used to record the occurrence of a single event or report detailed, operation specific statistics.

    path

    Used to log the path of the delta table when deltaLog is null.

    Attributes

    protected

    Definition Classes

    DeltaLogging

49.  def recordDeltaOperation[A](deltaLog: DeltaLog, opType: String, tags: Map[TagDefinition, String] = Map.empty)(thunk: => A): A

    Used to report the duration as well as the success or failure of an operation on a deltaLog.

    Used to report the duration as well as the success or failure of an operation on a deltaLog.

    Attributes

    protected

    Definition Classes

    DeltaLogging

50.  def recordDeltaOperationForTablePath[A](tablePath: String, opType: String, tags: Map[TagDefinition, String] = Map.empty)(thunk: => A): A

    Used to report the duration as well as the success or failure of an operation on a tahoePath.

    Used to report the duration as well as the success or failure of an operation on a tahoePath.

    Attributes

    protected

    Definition Classes

    DeltaLogging

51.  def recordEvent(metric: MetricDefinition, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, trimBlob: Boolean = true): Unit

    Definition Classes

    DatabricksLogging

52.  def recordFrameProfile[T](group: String, name: String)(thunk: => T): T

    Attributes

    protected

    Definition Classes

    DeltaLogging

53.  def recordOperation[S](opType: OpType, opTarget: String = null, extraTags: Map[TagDefinition, String], isSynchronous: Boolean = true, alwaysRecordStats: Boolean = false, allowAuthTags: Boolean = false, killJvmIfStuck: Boolean = false, outputMetric: MetricDefinition = METRIC_OPERATION_DURATION, silent: Boolean = true)(thunk: => S): S

    Definition Classes

    DatabricksLogging

54.  def recordProductEvent(metric: MetricDefinition with CentralizableMetric, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, trimBlob: Boolean = true): Unit

    Definition Classes

    DatabricksLogging

55.  def recordProductUsage(metric: MetricDefinition with CentralizableMetric, quantity: Double, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, forceSample: Boolean = false, trimBlob: Boolean = true, silent: Boolean = false): Unit

    Definition Classes

    DatabricksLogging

56.  def recordUsage(metric: MetricDefinition, quantity: Double, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, forceSample: Boolean = false, trimBlob: Boolean = true, silent: Boolean = false): Unit

    Definition Classes

    DatabricksLogging

57.  def removeClusteringColumnsProperty(configuration: Map[String, String]): Map[String, String]

    Remove PROP_CLUSTERING_COLUMNS from metadata action.

    Remove PROP_CLUSTERING_COLUMNS from metadata action. Clustering columns should only exist in: 1. CatalogTable.properties(PROP_CLUSTERING_COLUMNS) 2. Clustering metadata domain.

    configuration

    original configuration.

    returns

    new configuration without clustering columns property

58.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

59.  def toString(): String

    Definition Classes

    AnyRef → Any

60.  def validateClusteringColumnsInSnapshot(snapshot: Snapshot, clusterBySpec: ClusterBySpec): Unit

    Validate that the given clusterBySpec matches the existing table's in the given snapshot.

    Validate that the given clusterBySpec matches the existing table's in the given snapshot. This is used for append mode and replaceWhere.

61.  def validateClusteringColumnsInStatsSchema(protocol: Protocol, metadata: Metadata, clusterBy: ClusterBySpec): Unit

    Validate stats will be collected for all clustering columns.

    Validate stats will be collected for all clustering columns.

    This version is used when Snapshot doesn't have latest stats column information such as CREATE TABLE... where the initial snapshot doesn't have updated metadata / protocol yet.

62.  def validateClusteringColumnsInStatsSchema(snapshot: Snapshot, logicalClusteringColumns: Seq[String]): Unit

    Validate stats will be collected for all clustering columns.

63.  def validateExistingTableFeatureProperties(existingProperties: Map[String, String]): Unit

    Verify user didn't set clustering table feature in table properties.

    Verify user didn't set clustering table feature in table properties.

    existingProperties

    Table properties set by the user when creating a clustered table.

64.  def validateNumClusteringColumns(clusteringColumns: Seq[Seq[String]], deltaLogOpt: Option[DeltaLog] = None): Unit

    Validate the number of clustering columns doesn't exceed the limit.

    Validate the number of clustering columns doesn't exceed the limit.

    clusteringColumns

    clustering columns for the table.

    deltaLogOpt

    optional delta log. If present, will be used to record a delta event.

65.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

66.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

67.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()

68.  def withStatusCode[T](statusCode: String, defaultMessage: String, data: Map[String, Any] = Map.empty)(body: => T): T

    Report a log to indicate some command is running.

    Report a log to indicate some command is running.

    Definition Classes

    DeltaProgressReporter