Class StreamingWordExtract


  • public class StreamingWordExtract
    extends java.lang.Object
    A streaming Beam Example using BigQuery output.

    This pipeline example reads lines of the input text file, splits each line into individual words, capitalizes those words, and writes the output to a BigQuery table.

    The example is configured to use the default BigQuery table from the example common package (there are no defaults for a general Beam pipeline). You can override them by using the --bigQueryDataset, and --bigQueryTable options. If the BigQuery table do not exist, the example will try to create them.

    The example will try to cancel the pipelines on the signal to terminate the process (CTRL-C) and then exits.

    • Constructor Detail

      • StreamingWordExtract

        public StreamingWordExtract()
    • Method Detail

      • main

        public static void main​(java.lang.String[] args)
                         throws java.io.IOException
        Sets up and starts streaming pipeline.
        Throws:
        java.io.IOException - if there is a problem setting up resources