org.apache.beam.runners.flink.translation.wrappers.streaming.io

Class UnboundedSocketSource<CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark>

java.lang.Object

org.apache.beam.sdk.io.Source<OutputT>

org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT>

org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSocketSource<CheckpointMarkT>

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class UnboundedSocketSource<CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark>
extends org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT>

An example unbounded Beam source that reads input from a socket. This is used mainly for testing and debugging.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	UnboundedSocketSource.UnboundedSocketReader Unbounded socket reader.

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.UnboundedSource

org.apache.beam.sdk.io.UnboundedSource.CheckpointMark, org.apache.beam.sdk.io.UnboundedSource.UnboundedReader<OutputT>

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.Source

org.apache.beam.sdk.io.Source.Reader<T>

Constructor Summary

Constructors

Constructor and Description
UnboundedSocketSource(java.lang.String hostname, int port, char delimiter, long maxNumRetries)
UnboundedSocketSource(java.lang.String hostname, int port, char delimiter, long maxNumRetries, long delayBetweenRetries)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.io.UnboundedSource.UnboundedReader<java.lang.String>	createReader(org.apache.beam.sdk.options.PipelineOptions options, CheckpointMarkT checkpointMark)
org.apache.beam.sdk.coders.Coder	getCheckpointMarkCoder()
long	getDelayBetweenRetries()
char	getDelimiter()
java.lang.String	getHostname()
long	getMaxNumRetries()
org.apache.beam.sdk.coders.Coder<java.lang.String>	getOutputCoder()
int	getPort()
java.util.List<? extends org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT>>	split(int desiredNumSplits, org.apache.beam.sdk.options.PipelineOptions options)
void	validate()

Methods inherited from class org.apache.beam.sdk.io.UnboundedSource

requiresDeduping

Methods inherited from class org.apache.beam.sdk.io.Source

getDefaultOutputCoder, populateDisplayData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UnboundedSocketSource

public UnboundedSocketSource(java.lang.String hostname,
                             int port,
                             char delimiter,
                             long maxNumRetries)

UnboundedSocketSource

public UnboundedSocketSource(java.lang.String hostname,
                             int port,
                             char delimiter,
                             long maxNumRetries,
                             long delayBetweenRetries)

Method Detail

getHostname

public java.lang.String getHostname()

getPort

public int getPort()

getDelimiter

public char getDelimiter()

getMaxNumRetries

public long getMaxNumRetries()

getDelayBetweenRetries

public long getDelayBetweenRetries()

split

public java.util.List<? extends org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT>> split(int desiredNumSplits,
                                                                                                                org.apache.beam.sdk.options.PipelineOptions options)
                                                                                                         throws java.lang.Exception

Specified by:

split in class org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark>

Throws:

java.lang.Exception

createReader

public org.apache.beam.sdk.io.UnboundedSource.UnboundedReader<java.lang.String> createReader(org.apache.beam.sdk.options.PipelineOptions options,
                                                                                             @Nullable
                                                                                             CheckpointMarkT checkpointMark)

Specified by:

createReader in class org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark>

getCheckpointMarkCoder

@Nullable
public org.apache.beam.sdk.coders.Coder getCheckpointMarkCoder()

Specified by:

getCheckpointMarkCoder in class org.apache.beam.sdk.io.UnboundedSource<java.lang.String,CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark>

validate

public void validate()

Overrides:

validate in class org.apache.beam.sdk.io.Source<java.lang.String>

getOutputCoder

public org.apache.beam.sdk.coders.Coder<java.lang.String> getOutputCoder()

Overrides:

getOutputCoder in class org.apache.beam.sdk.io.Source<java.lang.String>