org.apache.gobblin.records

Interface RecordStreamProcessor<SI,SO,DI,DO>

Type Parameters:

SI - input schema type

SO - output schema type

DI - input data type

DO - output data type

All Known Implementing Classes:

ControlMessageInjector, Converter

public interface RecordStreamProcessor<SI,SO,DI,DO>

An object that applies some function to a RecordStreamWithMetadata. For example, converters, quality checkers (filters), etc. are instances of this.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	RecordStreamProcessor.StreamProcessingException Exception allowed by processStream(RecordStreamWithMetadata, WorkUnitState).

Method Summary

Modifier and Type	Method and Description
RecordStreamWithMetadata<DO,SO>	processStream(RecordStreamWithMetadata<DI,SI> inputStream, WorkUnitState state) Return a RecordStreamWithMetadata with the appropriate modifications.

Method Detail

processStream

RecordStreamWithMetadata<DO,SO> processStream(RecordStreamWithMetadata<DI,SI> inputStream,
                                              WorkUnitState state)
                                       throws RecordStreamProcessor.StreamProcessingException

Return a RecordStreamWithMetadata with the appropriate modifications.

Throws:

RecordStreamProcessor.StreamProcessingException