org.apache.beam.examples.complete

Class TrafficMaxLaneFlow

java.lang.Object

org.apache.beam.examples.complete.TrafficMaxLaneFlow

public class TrafficMaxLaneFlow
extends java.lang.Object

A Beam Example that runs in both batch and streaming modes with traffic sensor data. You can configure the running mode by setting --streaming to true or false.

Concepts: The batch and streaming runners, sliding windows, use of the AvroCoder to encode a custom class, and custom Combine transforms.

This example analyzes traffic sensor data using SlidingWindows. For each window, it finds the lane that had the highest flow recorded, for each sensor station. It writes those max values along with auxiliary info to a BigQuery table.

The pipeline reads traffic sensor data from --inputFile.

The example is configured to use the default BigQuery table from the example common package (there are no defaults for a general Beam pipeline). You can override them by using the --bigQueryDataset, and --bigQueryTable options. If the BigQuery table do not exist, the example will try to create them.

The example will try to cancel the pipelines on the signal to terminate the process (CTRL-C) and then exits.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TrafficMaxLaneFlow.MaxFlow A custom 'combine function' used with the Combine.perKey transform.
static interface	TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions Options supported by TrafficMaxLaneFlow.

Constructor Summary

Constructors

Constructor and Description
TrafficMaxLaneFlow()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) Sets up and starts streaming pipeline.
static void	runTrafficMaxLaneFlow(TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions options)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TrafficMaxLaneFlow

public TrafficMaxLaneFlow()

Method Detail

runTrafficMaxLaneFlow

public static void runTrafficMaxLaneFlow(TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions options)
                                  throws java.io.IOException

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Sets up and starts streaming pipeline.

Throws:

java.io.IOException - if there is a problem setting up resources