org.apache.hudi.utilities.sources

Class JsonSource

java.lang.Object

org.apache.hudi.utilities.sources.Source<org.apache.spark.api.java.JavaRDD<String>>

org.apache.hudi.utilities.sources.JsonSource

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

JsonDFSSource, JsonKafkaSource

public abstract class JsonSource
extends Source<org.apache.spark.api.java.JavaRDD<String>>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.utilities.sources.Source

Source.SourceType

Field Summary

Fields inherited from class org.apache.hudi.utilities.sources.Source

log, props, sparkContext, sparkSession

Constructor Summary

Constructors

Constructor and Description
JsonSource(TypedProperties props, org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.spark.sql.SparkSession sparkSession, SchemaProvider schemaProvider)

Method Summary

Methods inherited from class org.apache.hudi.utilities.sources.Source

fetchNewData, fetchNext, getSourceType, getSparkSession

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonSource

public JsonSource(TypedProperties props,
                  org.apache.spark.api.java.JavaSparkContext sparkContext,
                  org.apache.spark.sql.SparkSession sparkSession,
                  SchemaProvider schemaProvider)