org.apache.beam.examples.complete

Class StreamingWordExtract

java.lang.Object

org.apache.beam.examples.complete.StreamingWordExtract

public class StreamingWordExtract
extends java.lang.Object

A streaming Beam Example using BigQuery output.

This pipeline example reads lines of the input text file, splits each line into individual words, capitalizes those words, and writes the output to a BigQuery table.

The example is configured to use the default BigQuery table from the example common package (there are no defaults for a general Beam pipeline). You can override them by using the --bigQueryDataset, and --bigQueryTable options. If the BigQuery table do not exist, the example will try to create them.

The example will try to cancel the pipelines on the signal to terminate the process (CTRL-C) and then exits.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	StreamingWordExtract.StreamingWordExtractOptions Options supported by StreamingWordExtract.

Constructor Summary

Constructors

Constructor and Description
StreamingWordExtract()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) Sets up and starts streaming pipeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamingWordExtract

public StreamingWordExtract()

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Sets up and starts streaming pipeline.

Throws:

java.io.IOException - if there is a problem setting up resources