org.apache.beam.examples.cookbook

Class BigQueryTornadoes

java.lang.Object

org.apache.beam.examples.cookbook.BigQueryTornadoes

public class BigQueryTornadoes
extends java.lang.Object

An example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.

Concepts: Reading/writing BigQuery; counting a PCollection; user-defined PTransforms

Note: Before running this example, you must create a BigQuery dataset to contain your output table.

To execute this pipeline locally, specify the BigQuery table for the output with the form:

 --output=YOUR_PROJECT_ID:DATASET_ID.TABLE_ID
 

To change the runner, specify:

 --runner=YOUR_SELECTED_RUNNER
 

See examples/java/README.md for instructions about how to configure different runners.

The BigQuery input table defaults to clouddataflow-readonly:samples.weather_stations and can be overridden with --input.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	BigQueryTornadoes.Options Options supported by BigQueryTornadoes.

Constructor Summary

Constructors

Constructor and Description
BigQueryTornadoes()

Method Summary

Modifier and Type	Method and Description
static void	applyBigQueryTornadoes(org.apache.beam.sdk.Pipeline p, BigQueryTornadoes.Options options)
static void	main(java.lang.String[] args)
static void	runBigQueryTornadoes(BigQueryTornadoes.Options options)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQueryTornadoes

public BigQueryTornadoes()

Method Detail

applyBigQueryTornadoes

public static void applyBigQueryTornadoes(org.apache.beam.sdk.Pipeline p,
                                          BigQueryTornadoes.Options options)

runBigQueryTornadoes

public static void runBigQueryTornadoes(BigQueryTornadoes.Options options)

main

public static void main(java.lang.String[] args)