package convert
- Alphabetic
- Public
- All
Type Members
-
class
CatalogFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated through listing partition paths from Metastore catalog.
-
case class
ConvertTargetFile(fileStatus: SerializableFileStatus, partitionValues: Option[Map[String, String]] = None, parquetSchemaDDL: Option[String] = None) extends Serializable with Product
An interface for the file to be included during conversion.
An interface for the file to be included during conversion.
- fileStatus
the file info
- partitionValues
partition values of this file that may be available from the source table format. If none, the converter will infer partition values from the file path, assuming the Hive directory format.
- parquetSchemaDDL
the Parquet schema DDL associated with the file.
-
trait
ConvertTargetFileManifest extends Closeable
An interface for providing an iterator of files for a table.
-
trait
ConvertTargetTable extends AnyRef
An interface for the table to be converted to Delta.
- trait ConvertUtilsBase extends DeltaLogging
-
class
ManualListingFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated through recursively listing a base path.
-
class
MetadataLogFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated from pre-existing parquet MetadataLog.
-
case class
ParquetSchemaFetchConfig(assumeBinaryIsString: Boolean, assumeInt96IsTimestamp: Boolean, ignoreCorruptFiles: Boolean) extends Product with Serializable
Configuration for fetching Parquet schema.
-
class
ParquetTable extends ConvertTargetTable with DeltaLogging
A target Parquet table for conversion to a Delta table.
Value Members
- object ConvertUtils extends ConvertUtilsBase