public class DFSDeltaWriterAdapter extends Object implements DeltaWriterAdapter<org.apache.avro.generic.GenericRecord>
DistributedFileSystem (or LocalFileSystem) based delta generator.DeltaWriterAdapter.SparkBasedDeltaWriter<J>| Constructor and Description |
|---|
DFSDeltaWriterAdapter(DeltaInputWriter<org.apache.avro.generic.GenericRecord> deltaInputWriter) |
DFSDeltaWriterAdapter(DeltaInputWriter<org.apache.avro.generic.GenericRecord> deltaInputWriter,
int preCombineFieldVal) |
| Modifier and Type | Method and Description |
|---|---|
void |
rollOver() |
List<DeltaWriteStats> |
write(Iterator<org.apache.avro.generic.GenericRecord> input) |
public DFSDeltaWriterAdapter(DeltaInputWriter<org.apache.avro.generic.GenericRecord> deltaInputWriter, int preCombineFieldVal)
public DFSDeltaWriterAdapter(DeltaInputWriter<org.apache.avro.generic.GenericRecord> deltaInputWriter)
public List<DeltaWriteStats> write(Iterator<org.apache.avro.generic.GenericRecord> input) throws IOException
write in interface DeltaWriterAdapter<org.apache.avro.generic.GenericRecord>IOExceptionpublic void rollOver()
throws IOException
IOExceptionCopyright © 2023 The Apache Software Foundation. All rights reserved.