org.apache.gobblin.source.extractor

Interface StreamingExtractor<S,D>

All Superinterfaces:

AutoCloseable, Closeable, Extractor<S,D>

@Alpha
public interface StreamingExtractor<S,D>
extends Extractor<S,D>

An interface for implementing streaming / continuous extractors

Method Summary

Modifier and Type	Method and Description
void	start(WatermarkStorage watermarkStorage) Initialize the extractor to be ready to read records

Methods inherited from interface org.apache.gobblin.source.extractor.Extractor

getExpectedRecordCount, getHighWatermark, getSchema, readRecord, readRecordEnvelope, readStreamEntity, recordStream, shutdown

Methods inherited from interface java.io.Closeable

close

Method Detail

start

void start(WatermarkStorage watermarkStorage)
    throws IOException

Initialize the extractor to be ready to read records

Parameters:

watermarkStorage - : watermark storage to retrieve previously committed watermarks

Throws:

IOException - : typically if there was a failure in retrieving watermarks