class SparkToGeoParquetSchemaConverter extends SparkToParquetSchemaConverter
This converter class is used to convert Spark SQL StructType to Parquet MessageType.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- SparkToGeoParquetSchemaConverter
- SparkToParquetSchemaConverter
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Instance Constructors
- new SparkToGeoParquetSchemaConverter(conf: Configuration)
- new SparkToGeoParquetSchemaConverter(conf: SQLConf)
- new SparkToGeoParquetSchemaConverter(writeLegacyParquetFormat: Boolean = SQLConf.PARQUET_WRITE_LEGACY_FORMAT.defaultValue.get, outputTimestampType: internal.SQLConf.ParquetOutputTimestampType.Value = SQLConf.ParquetOutputTimestampType.INT96)
- writeLegacyParquetFormat
Whether to use legacy Parquet format compatible with Spark 1.4 and prior versions when converting a Catalyst StructType to a Parquet MessageType. When set to false, use standard format defined in parquet-format spec. This argument only affects Parquet write path.
- outputTimestampType
which parquet timestamp type to use when writing.
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native() @HotSpotIntrinsicCandidate()
- def convert(catalystSchema: StructType): MessageType
Converts a Spark SQL StructType to a Parquet MessageType.
Converts a Spark SQL StructType to a Parquet MessageType.
- Definition Classes
- SparkToGeoParquetSchemaConverter → SparkToParquetSchemaConverter
- def convertField(field: StructField): Type
Converts a Spark SQL StructField to a Parquet Type.
Converts a Spark SQL StructField to a Parquet Type.
- Definition Classes
- SparkToGeoParquetSchemaConverter → SparkToParquetSchemaConverter
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated