org.apache.hudi.internal

类 DefaultSource

java.lang.Object

org.apache.hudi.internal.BaseDefaultSource

org.apache.hudi.internal.DefaultSource

所有已实现的接口:

org.apache.spark.sql.sources.DataSourceRegister, org.apache.spark.sql.sources.v2.DataSourceV2, org.apache.spark.sql.sources.v2.ReadSupport, org.apache.spark.sql.sources.v2.WriteSupport

public class DefaultSource
extends BaseDefaultSource
implements org.apache.spark.sql.sources.v2.DataSourceV2, org.apache.spark.sql.sources.v2.ReadSupport, org.apache.spark.sql.sources.v2.WriteSupport, org.apache.spark.sql.sources.DataSourceRegister

DataSource V2 implementation for managing internal write logic. Only called internally.

字段概要

从类继承的字段 org.apache.hudi.internal.BaseDefaultSource

configuration, sparkSession

构造器概要

构造器

构造器和说明
DefaultSource()

方法概要

限定符和类型	方法和说明
org.apache.spark.sql.sources.v2.reader.DataSourceReader	createReader(org.apache.spark.sql.sources.v2.DataSourceOptions options)
org.apache.spark.sql.sources.v2.reader.DataSourceReader	createReader(org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.sources.v2.DataSourceOptions options)
Optional<org.apache.spark.sql.sources.v2.writer.DataSourceWriter>	createWriter(String writeUUID, org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.SaveMode mode, org.apache.spark.sql.sources.v2.DataSourceOptions options)
String	shortName()

从类继承的方法 org.apache.hudi.internal.BaseDefaultSource

getConfiguration, getSparkSession

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DefaultSource

public DefaultSource()

方法详细资料

shortName

public String shortName()

指定者:

shortName 在接口中 org.apache.spark.sql.sources.DataSourceRegister

createReader

public org.apache.spark.sql.sources.v2.reader.DataSourceReader createReader(org.apache.spark.sql.types.StructType schema,
                                                                            org.apache.spark.sql.sources.v2.DataSourceOptions options)

指定者:

createReader 在接口中 org.apache.spark.sql.sources.v2.ReadSupport

createReader

public org.apache.spark.sql.sources.v2.reader.DataSourceReader createReader(org.apache.spark.sql.sources.v2.DataSourceOptions options)

指定者:

createReader 在接口中 org.apache.spark.sql.sources.v2.ReadSupport

createWriter

public Optional<org.apache.spark.sql.sources.v2.writer.DataSourceWriter> createWriter(String writeUUID,
                                                                                      org.apache.spark.sql.types.StructType schema,
                                                                                      org.apache.spark.sql.SaveMode mode,
                                                                                      org.apache.spark.sql.sources.v2.DataSourceOptions options)

指定者:

createWriter 在接口中 org.apache.spark.sql.sources.v2.WriteSupport