Package org.apache.beam.examples.cookbook

Class CombinePerKeyExamples

java.lang.Object

org.apache.beam.examples.cookbook.CombinePerKeyExamples

public class CombinePerKeyExamples
extends java.lang.Object

An example that reads the public 'Shakespeare' data, and for each word in the dataset that is over a given length, generates a string containing the list of play names in which that word appears, and saves this information to a bigquery table.

Note: Before running this example, you must create a BigQuery dataset to contain your output table.

To execute this pipeline locally, specify the BigQuery table for the output:

 --output=YOUR_PROJECT_ID:DATASET_ID.TABLE_ID
 

To change the runner, specify:

 --runner=YOUR_SELECTED_RUNNER
 

See examples/java/README.md for instructions about how to configure different runners.

The BigQuery input table defaults to publicdata:samples.shakespeare and can be overridden with --input.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	CombinePerKeyExamples.ConcatWords	A 'combine function' used with the Combine.perKey transform.
static interface	CombinePerKeyExamples.Options	Options supported by CombinePerKeyExamples.

Constructor Summary

Constructors

Constructor	Description
CombinePerKeyExamples()

Method Summary

Modifier and Type	Method	Description
static void	main(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinePerKeyExamples

public CombinePerKeyExamples()

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception