Type Members

1.  trait ClusteredTableUtilsBase extends DeltaLogging

   Clustered table utility functions.

2.  case class ClusteringColumn(physicalName: Seq[String]) extends Product with Serializable

   A wrapper class that stores a clustering column's physical name parts.

3.  case class ClusteringColumnInfo(physicalName: Seq[String], dataType: DataType, schema: StructType) extends Product with Serializable

   A wrapper class that stores a clustering column's physical name parts and data type.

4.  case class ClusteringFileStats(numFiles: Long, size: Long) extends Product with Serializable

   Aggregated file stats for a category of ZCube files.

   Aggregated file stats for a category of ZCube files.

   numFiles

   Total number of files.

   size

   Total physical size of files in bytes.

5.  case class ClusteringStats(inputZCubeFiles: ClusteringFileStats, inputOtherFiles: ClusteringFileStats, inputNumZCubes: Long, mergedFiles: ClusteringFileStats, numOutputZCubes: Long) extends Product with Serializable

   Aggregated stats for OPTIMIZE command on clustered tables.

   Aggregated stats for OPTIMIZE command on clustered tables.

   inputZCubeFiles

   Files in the ZCubes matching the current OPTIMIZE operation.

   inputOtherFiles

   Files not in any ZCubes or in other ZCubes with different clustering columns.

   inputNumZCubes

   Number of different cubes among input files.

   mergedFiles

   Subset of input files merged by the current operation

   numOutputZCubes

   Number of output ZCubes written out

6.  case class ClusteringStatsCollector(zOrderBy: Seq[String], optimizeContext: DeltaOptimizeContext) extends Product with Serializable

   A class help collecting ClusteringStats.

7.  case class MatchingMetadataDomain(clusteringDomainOpt: Option[DomainMetadata]) extends Product with Serializable
8.  case class ZCube(files: Seq[AddFile]) extends Product with Serializable

   Collection of files that were produced by the same job in a run of the clustering command.