package convert
- Alphabetic
- Public
- Protected
Type Members
- class CatalogFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated through listing partition paths from Metastore catalog.
- case class ConvertTargetFile(fileStatus: SerializableFileStatus, partitionValues: Option[Map[String, String]] = None, parquetSchemaDDL: Option[String] = None) extends Serializable with Product
An interface for the file to be included during conversion.
An interface for the file to be included during conversion.
- fileStatus
the file info
- partitionValues
partition values of this file that may be available from the source table format. If none, the converter will infer partition values from the file path, assuming the Hive directory format.
- parquetSchemaDDL
the Parquet schema DDL associated with the file.
- trait ConvertTargetFileManifest extends Closeable
An interface for providing an iterator of files for a table.
- trait ConvertTargetTable extends AnyRef
An interface for the table to be converted to Delta.
- trait ConvertUtilsBase extends DeltaLogging
- class ManualListingFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated through recursively listing a base path.
- class MetadataLogFileManifest extends ConvertTargetFileManifest with DeltaLogging
A file manifest generated from pre-existing parquet MetadataLog.
- case class ParquetSchemaFetchConfig(assumeBinaryIsString: Boolean, assumeInt96IsTimestamp: Boolean, ignoreCorruptFiles: Boolean) extends Product with Serializable
Configuration for fetching Parquet schema.
- class ParquetTable extends ConvertTargetTable with DeltaLogging
A target Parquet table for conversion to a Delta table.
Value Members
- object ConvertUtils extends ConvertUtilsBase