Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final val TIME_TRAVEL_SOURCE_KEY: String("__time_travel_source__")
5.  final val TIME_TRAVEL_TIMESTAMP_KEY: String("timestampAsOf")

   The option key for time traveling using a timestamp.

   The option key for time traveling using a timestamp. The timestamp should be a valid timestamp string which can be cast to a timestamp type.

6.  final val TIME_TRAVEL_VERSION_KEY: String("versionAsOf")

   The option key for time traveling using a version of a table.

   The option key for time traveling using a version of a table. This value should be castable to a long.

7.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

9.  def decodePartitioningColumns(str: String): Seq[String]
10.  def encodePartitioningColumns(columns: Seq[String]): String
11.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

12.  def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

13.  def extractDeltaPath(dataset: Dataset[_]): Option[String]

    Extract the Delta path if dataset is created to load a Delta table.

    Extract the Delta path if dataset is created to load a Delta table. Otherwise returns None. Table UI in universe will call this.

14.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

15.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

16.  def getTimeTravelVersion(parameters: Map[String, String]): Option[DeltaTimeTravelSpec]

    Extracts whether users provided the option to time travel a relation.

17.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

18.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

19.  def logConsole(line: String): Unit

    Definition Classes

    DatabricksLogging

20.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

21.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

22.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

23.  def parsePathIdentifier(spark: SparkSession, userPath: String): (Path, Seq[(String, String)], Option[DeltaTimeTravelSpec])

    For Delta, we allow certain magic to be performed through the paths that are provided by users.

    For Delta, we allow certain magic to be performed through the paths that are provided by users. Normally, a user specified path should point to the root of a Delta table. However, some users are used to providing specific partition values through the path, because of how expensive it was to perform partition discovery before. We treat these partition values as logical partition filters, if a table does not exist at the provided path.

    In addition, we allow users to provide time travel specifications through the path. This is provided after an @ symbol after a path followed by a time specification in yyyyMMddHHmmssSSS format, or a version number preceded by a v.

    This method parses these specifications and returns these modifiers only if a path does not really exist at the provided path. We first parse out the time travel specification, and then the partition filters. For example, a path specified as: /some/path/partition=1@v1234 will be parsed into /some/path with filters partition=1 and a time travel spec of version 1234.

    returns

    A tuple of the root path of the Delta table, partition filters, and time travel options

24.  def recordEvent(metric: MetricDefinition, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, trimBlob: Boolean = true): Unit

    Definition Classes

    DatabricksLogging

25.  def recordOperation[S](opType: OpType, opTarget: String = null, extraTags: Map[TagDefinition, String], isSynchronous: Boolean = true, alwaysRecordStats: Boolean = false, allowAuthTags: Boolean = false, killJvmIfStuck: Boolean = false, outputMetric: MetricDefinition = null, silent: Boolean = true)(thunk: ⇒ S): S

    Definition Classes

    DatabricksLogging

26.  def recordUsage(metric: MetricDefinition, quantity: Double, additionalTags: Map[TagDefinition, String] = Map.empty, blob: String = null, forceSample: Boolean = false, trimBlob: Boolean = true, silent: Boolean = false): Unit

    Definition Classes

    DatabricksLogging

27.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

28.  def toString(): String

    Definition Classes

    AnyRef → Any

29.  def verifyAndCreatePartitionFilters(userPath: String, deltaLog: DeltaLog, partitionFilters: Seq[(String, String)]): Seq[Expression]

    Verifies that the provided partition filters are valid and returns the corresponding expressions.

30.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

31.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

32.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()