| Interface | Description |
|---|---|
| DeltaInputWriter<I> |
Implementations of
DeltaInputWriter will be able to generate data. |
| DeltaWriterAdapter<I> |
Adapter use Delta Writer.
|
| DeltaWriterAdapter.SparkBasedDeltaWriter<J> |
| Class | Description |
|---|---|
| AvroFileDeltaInputWriter |
Implementation of
DeltaInputWriter that writes avro records to the result file. |
| DeltaWriterFactory |
A factory to help instantiate different
DeltaWriterAdapters depending on the DeltaOutputMode and DeltaInputType. |
| DeltaWriteStats |
This class holds the write statistics for
DeltaInputWriter. |
| DFSDeltaWriterAdapter |
DistributedFileSystem (or LocalFileSystem) based delta generator. |
| DFSSparkAvroDeltaWriter |
NEED TO IMPLEMENT A CUSTOM SPARK PARTITIONER TO ENSURE WE WRITE LARGE ENOUGH AVRO FILES.
|
| SparkAvroDeltaInputWriter |
Spark based avro delta input writer.
|
| Enum | Description |
|---|---|
| DeltaOutputMode |
Supported output destination types for the generated delta workload.
|
Copyright © 2023 The Apache Software Foundation. All rights reserved.