org.apache.hudi.integ.testsuite.writer

类 DFSSparkAvroDeltaWriter

java.lang.Object

org.apache.hudi.integ.testsuite.writer.DFSSparkAvroDeltaWriter

所有已实现的接口:

DeltaWriterAdapter.SparkBasedDeltaWriter<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>>

public class DFSSparkAvroDeltaWriter
extends Object
implements DeltaWriterAdapter.SparkBasedDeltaWriter<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>>

NEED TO IMPLEMENT A CUSTOM SPARK PARTITIONER TO ENSURE WE WRITE LARGE ENOUGH AVRO FILES.

构造器概要

构造器

构造器和说明
DFSSparkAvroDeltaWriter(DeltaInputWriter<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>> deltaInputWriter)

方法概要

限定符和类型	方法和说明
org.apache.spark.api.java.JavaRDD<DeltaWriteStats>	write(org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord> input)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DFSSparkAvroDeltaWriter

public DFSSparkAvroDeltaWriter(DeltaInputWriter<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>> deltaInputWriter)

方法详细资料

write

public org.apache.spark.api.java.JavaRDD<DeltaWriteStats> write(org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord> input)
                                                         throws IOException

指定者:

write 在接口中 DeltaWriterAdapter.SparkBasedDeltaWriter<org.apache.spark.api.java.JavaRDD<org.apache.avro.generic.GenericRecord>>

抛出:

IOException