Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  def absolutePath(child: String): Path

   Definition Classes

   TahoeFileIndex

5.  val actionType: String
6.  val addFiles: Seq[AddFile]
7.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

9.  val deltaLog: DeltaLog

   Definition Classes

   TahoeFileIndex → SnapshotDescriptor

10.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

11.  def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

12.  def fileStatusWithMetadataFromAddFile(addFile: AddFile): FileStatusWithMetadata

    Generates a FileStatusWithMetadata using data extracted from a given AddFile.

    Generates a FileStatusWithMetadata using data extracted from a given AddFile.

    Definition Classes

    TahoeFileIndex

13.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

14.  def getBasePath(filePath: Path): Option[Path]

    Returns the path of the base directory of the given file path (i.e.

    Returns the path of the base directory of the given file path (i.e. its parent directory with all the partition directories stripped off).

    Definition Classes

    TahoeFileIndex

15.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

16.  def getPartitionValuesRow(partitionValues: Map[String, String]): GenericInternalRow

    Attributes

    protected

    Definition Classes

    TahoeFileIndex

17.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

18.  def inputFiles: Array[String]

    Definition Classes

    TahoeBatchFileIndex → FileIndex

19.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

20.  def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory]

    Definition Classes

    TahoeFileIndex → FileIndex

21.  def listPartitionsAsAddFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): (Seq[(InternalRow, Seq[AddFile])], Seq[AddFile])

    Returns (i) tuples of partition directories to their respective AddFile actions and (ii) a collection of matched AddFiles.

    Returns (i) tuples of partition directories to their respective AddFile actions and (ii) a collection of matched AddFiles. The matched AddFiles are those that meet the criteria set by the partition and data filters. Essentially, this is a collection of all the files associated with the identified partitions.

    Definition Classes

    TahoeFileIndex

22.  def makePartitionDirectories(partitionValuesToFiles: Seq[(InternalRow, Seq[AddFile])]): Seq[PartitionDirectory]

    Definition Classes

    TahoeFileIndex

23.  def matchingFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[AddFile]

    Returns all matching/valid files by the given partitionFilters and dataFilters.

    Returns all matching/valid files by the given partitionFilters and dataFilters. Implementations may avoid evaluating data filters when doing so would be expensive, but *must* evaluate the partition filters; wrong results will be produced if AddFile entries which don't match the partition filters are returned.

    Definition Classes

    TahoeBatchFileIndex → TahoeFileIndex

24.  def metadata: Metadata

    Definition Classes

    TahoeFileIndexWithSnapshotDescriptor → SnapshotDescriptor

25.  def metadataOpsTimeNs: Option[Long]

    Definition Classes

    FileIndex

26.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

27.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

28.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

29.  def numOfFilesIfKnown: Option[Long]

    Attributes

    protected[delta]

    Definition Classes

    TahoeFileIndexWithSnapshotDescriptor → SnapshotDescriptor

30.  val partitionFiltersGenerated: Boolean
31.  def partitionSchema: StructType

    Definition Classes

    TahoeFileIndex → FileIndex

32.  val path: Path

    Definition Classes

    TahoeFileIndex

33.  def protocol: Protocol

    Definition Classes

    TahoeFileIndexWithSnapshotDescriptor → SnapshotDescriptor

34.  def refresh(): Unit

    Definition Classes

    TahoeBatchFileIndex → FileIndex

35.  def rootPaths: Seq[Path]

    Definition Classes

    TahoeFileIndex → FileIndex

36.  def rowIndexFilters: Option[Map[String, RowIndexFilterType]]

    If we know a-priori which exact rows we want to read (e.g., from a previous scan) find the per-file filter here, which must be passed down to the appropriate reader.

    If we know a-priori which exact rows we want to read (e.g., from a previous scan) find the per-file filter here, which must be passed down to the appropriate reader.

    returns

    a mapping from file names to the row index filter for that file.

    Definition Classes

    SupportsRowIndexFilters

37.  def schema: StructType

    Definition Classes

    SnapshotDescriptor

38.  lazy val sizeInBytes: Long

    Definition Classes

    TahoeBatchFileIndex → FileIndex

39.  def sizeInBytesIfKnown: Option[Long]

    Attributes

    protected[delta]

    Definition Classes

    TahoeFileIndexWithSnapshotDescriptor → SnapshotDescriptor

40.  val snapshot: SnapshotDescriptor
41.  val spark: SparkSession

    Definition Classes

    TahoeFileIndex

42.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

43.  def toString(): String

    Definition Classes

    TahoeFileIndex → FileIndex → AnyRef → Any

44.  def version: Long

    Definition Classes

    TahoeFileIndexWithSnapshotDescriptor → SnapshotDescriptor

45.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

46.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

47.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()