org.apache.beam.examples.cookbook

Class CombinePerKeyExamples

java.lang.Object

org.apache.beam.examples.cookbook.CombinePerKeyExamples

public class CombinePerKeyExamples
extends java.lang.Object

An example that reads the public 'Shakespeare' data, and for each word in the dataset that is over a given length, generates a string containing the list of play names in which that word appears, and saves this information to a bigquery table.

Note: Before running this example, you must create a BigQuery dataset to contain your output table.

To execute this pipeline locally, specify the BigQuery table for the output:

 --output=YOUR_PROJECT_ID:DATASET_ID.TABLE_ID
 

To change the runner, specify:

 --runner=YOUR_SELECTED_RUNNER
 

See examples/java/README.md for instructions about how to configure different runners.

The BigQuery input table defaults to publicdata:samples.shakespeare and can be overridden with --input.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CombinePerKeyExamples.ConcatWords A 'combine function' used with the Combine.perKey transform.
static interface	CombinePerKeyExamples.Options Options supported by CombinePerKeyExamples.

Constructor Summary

Constructors

Constructor and Description
CombinePerKeyExamples()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinePerKeyExamples

public CombinePerKeyExamples()

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception