org.apache.hudi.utilities.sources

Class AvroSource

java.lang.Object

org.apache.hudi.utilities.sources.Source<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>>

org.apache.hudi.utilities.sources.AvroSource

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

AvroDFSSource, AvroKafkaSource, HiveIncrPullSource

public abstract class AvroSource
extends Source<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.utilities.sources.Source

Source.SourceType

Field Summary

Fields inherited from class org.apache.hudi.utilities.sources.Source

log, props, sparkContext, sparkSession

Constructor Summary

Constructors

Constructor and Description
AvroSource(TypedProperties props, org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.spark.sql.SparkSession sparkSession, SchemaProvider schemaProvider)

Method Summary

Methods inherited from class org.apache.hudi.utilities.sources.Source

fetchNewData, fetchNext, getSourceType, getSparkSession

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroSource

public AvroSource(TypedProperties props,
                  org.apache.spark.api.java.JavaSparkContext sparkContext,
                  org.apache.spark.sql.SparkSession sparkSession,
                  SchemaProvider schemaProvider)