A B C D E F G H I J K L M N O P R S T U V W

A

accessingValueProviderInfoAfterRunSnip1(String[]) - Static method in class org.apache.beam.examples.snippets.Snippets

addCommand(Integer, String) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs

apply(DoFn<InputT, TableRow>.ProcessContext, BoundedWindow) - Method in interface org.apache.beam.examples.complete.game.utils.WriteToBigQuery.FieldFn

apply(DoFn<InputT, String>.ProcessContext, BoundedWindow) - Method in interface org.apache.beam.examples.complete.game.utils.WriteToText.FieldFn

apply(Map<String, Object>) - Method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.SslConsumerFactoryFn

apply(Iterable<TrafficMaxLaneFlow.LaneInfo>) - Method in class org.apache.beam.examples.complete.TrafficMaxLaneFlow.MaxFlow

apply(Iterable<String>) - Method in class org.apache.beam.examples.cookbook.CombinePerKeyExamples.ConcatWords

apply(Row) - Method in class org.apache.beam.examples.multilanguage.PythonDataframeWordCount.FormatAsTextFn

apply(KV<String, Long>) - Method in class org.apache.beam.examples.WordCount.FormatAsTextFn

applyBigQueryTornadoes(Pipeline, BigQueryTornadoes.Options) - Static method in class org.apache.beam.examples.cookbook.BigQueryTornadoes

assignWindows(WindowFn.AssignContext) - Method in class org.apache.beam.examples.snippets.Snippets

assignWindows(WindowFn<TableRow, IntervalWindow>.AssignContext) - Method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

AutoComplete - Class in org.apache.beam.examples.complete

An example that computes the most popular hash tags for every prefix, which can be used for auto-completion.

AutoComplete() - Constructor for class org.apache.beam.examples.complete.AutoComplete

AutoComplete.ComputeTopCompletions - Class in org.apache.beam.examples.complete

A PTransform that takes as input a list of tokens and returns the most common tokens per prefix.

AutoComplete.Options - Interface in org.apache.beam.examples.complete

Options supported by this class.

AvroDataClass - Class in org.apache.beam.examples.complete.kafkatopubsub.avro

Example of AVRO serialization class.

AvroDataClass(String, Float, Float) - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

AvroDataClassKafkaAvroDeserializer - Class in org.apache.beam.examples.complete.kafkatopubsub.avro

Example of custom AVRO Deserialize.

AvroDataClassKafkaAvroDeserializer() - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClassKafkaAvroDeserializer

B

batchSize() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

BigQueryTableFactory() - Constructor for class org.apache.beam.examples.common.ExampleBigQueryTableOptions.BigQueryTableFactory

BigQueryTornadoes - Class in org.apache.beam.examples.cookbook

An example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.

BigQueryTornadoes() - Constructor for class org.apache.beam.examples.cookbook.BigQueryTornadoes

BigQueryTornadoes.Options - Interface in org.apache.beam.examples.cookbook

Options supported by BigQueryTornadoes.

BUCKET - Static variable in class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

build() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

build() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

build() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

build() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO.Builder

build() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors.Builder

build() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors.Builder

Builder() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder

BuildRowFn() - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToBigQuery.BuildRowFn

BuildRowFn() - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToText.BuildRowFn

BuildRowFn() - Constructor for class org.apache.beam.examples.complete.game.utils.WriteWindowedToBigQuery.BuildRowFn

C

CalculateSpammyUsers() - Constructor for class org.apache.beam.examples.complete.game.GameStats.CalculateSpammyUsers

CallingSubProcessUtils - Class in org.apache.beam.examples.subprocess.utils

Utility class for dealing with concurrency and binary file copies to the worker.

CallingSubProcessUtils.Permit - Class in org.apache.beam.examples.subprocess.utils

Permit class for access to worker cpu resources.

close() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.TokenizationFn

close() - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClassKafkaAvroDeserializer

close() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

Clean up the files that have been created on the local worker file system.

close() - Method in class org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils.Permit

coGroupByKeyTuple(TupleTag<String>, TupleTag<String>, PCollection<KV<String, String>>, PCollection<KV<String, String>>) - Static method in class org.apache.beam.examples.snippets.Snippets

Using a CoGroupByKey transform.

CombinePerKeyExamples - Class in org.apache.beam.examples.cookbook

An example that reads the public 'Shakespeare' data, and for each word in the dataset that is over a given length, generates a string containing the list of play names in which that word appears, and saves this information to a bigquery table.

CombinePerKeyExamples() - Constructor for class org.apache.beam.examples.cookbook.CombinePerKeyExamples

CombinePerKeyExamples.ConcatWords - Class in org.apache.beam.examples.cookbook

A 'combine function' used with the Combine.perKey transform.

CombinePerKeyExamples.Options - Interface in org.apache.beam.examples.cookbook

Options supported by CombinePerKeyExamples.

Command(int, String) - Constructor for class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs.Command

ComputeTfIdf() - Constructor for class org.apache.beam.examples.complete.TfIdf.ComputeTfIdf

ComputeTopCompletions(int, boolean) - Constructor for class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

ConcatWords() - Constructor for class org.apache.beam.examples.cookbook.CombinePerKeyExamples.ConcatWords

concurrency - Variable in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

configure(Map<String, ?>, boolean) - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClassKafkaAvroDeserializer

configureBigQueryWrite() - Static method in class org.apache.beam.examples.complete.game.LeaderBoard

Create a map of information that describes how to write pipeline output to BigQuery.

configureGlobalWindowBigQueryWrite() - Static method in class org.apache.beam.examples.complete.game.LeaderBoard

Create a map of information that describes how to write pipeline output to BigQuery.

configureKafka(Map<String, String>) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

Configures Kafka consumer for authorized connection.

configureOutput() - Static method in class org.apache.beam.examples.complete.game.HourlyTeamScore

Create a map of information that describes how to write pipeline output to text.

configureOutput() - Static method in class org.apache.beam.examples.complete.game.UserScore

Create a map of information that describes how to write pipeline output to text.

configureSessionWindowWrite() - Static method in class org.apache.beam.examples.complete.game.GameStats

Create a map of information that describes how to write pipeline output to BigQuery.

configureSsl(KafkaToPubsubOptions) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

configureWindowedTableWrite() - Static method in class org.apache.beam.examples.complete.game.LeaderBoard

Create a map of information that describes how to write pipeline output to BigQuery.

configureWindowedWrite() - Static method in class org.apache.beam.examples.complete.game.GameStats

Create a map of information that describes how to write pipeline output to BigQuery.

copyFile(ResourceId, ResourceId) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

copyFileFromGCSToWorker(ExecutableFile) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

copyFileFromWorkerToGCS(SubProcessConfiguration, Path) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

copyOutPutFilesToBucket(SubProcessConfiguration, String) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

Will copy the output files to the GCS path setup via the configuration.

CountWords() - Constructor for class org.apache.beam.examples.WordCount.CountWords

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExampleBigQueryTableOptions.BigQueryTableFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExamplePubsubTopicOptions.PubsubTopicFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.DelimiterFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.cookbook.DistinctExample.Options.OutputFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.subprocess.SubProcessPipelineOptions.SubProcessConfigurationFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.WindowedWordCount.DefaultToCurrentSystemTime

create(PipelineOptions) - Method in class org.apache.beam.examples.WindowedWordCount.DefaultToMinTimestampPlusOneHour

createDirectoriesOnWorker(SubProcessConfiguration) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

Create directories needed based on configuration.

CsvConverters - Class in org.apache.beam.examples.complete.datatokenization.utils

Common transforms for Csv files.

CsvConverters() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters

CsvConverters.CsvPipelineOptions - Interface in org.apache.beam.examples.complete.datatokenization.utils

Necessary PipelineOptions options for Csv Pipelines.

CsvConverters.DelimiterFactory - Class in org.apache.beam.examples.complete.datatokenization.utils

Default value factory to get delimiter from Csv format so that if the user does not pass one in, it matches the supplied CsvConverters.CsvPipelineOptions.getCsvFormat().

CsvConverters.FailsafeElementToJsonFn - Class in org.apache.beam.examples.complete.datatokenization.utils

The CsvConverters.FailsafeElementToJsonFn class creates a Json string from a failsafe element.

CsvConverters.LineToFailsafeJson - Class in org.apache.beam.examples.complete.datatokenization.utils

The CsvConverters.LineToFailsafeJson interface converts a line from a Csv file into a Json string.

CsvConverters.LineToFailsafeJson.Builder - Class in org.apache.beam.examples.complete.datatokenization.utils

Builder for CsvConverters.LineToFailsafeJson.

CsvConverters.ReadCsv - Class in org.apache.beam.examples.complete.datatokenization.utils

The CsvConverters.ReadCsv class is a PTransform that reads from one for more Csv files.

CsvConverters.ReadCsv.Builder - Class in org.apache.beam.examples.complete.datatokenization.utils

Builder for CsvConverters.ReadCsv.

csvDelimiter() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

csvFormat() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

CustomSessionPipeline() - Constructor for class org.apache.beam.examples.snippets.Snippets.CustomSessionPipeline

D

DataProtectors - Class in org.apache.beam.examples.complete.datatokenization.transforms

The DataProtectors Using passing parameters transform will buffer input rows in batch and will send it when the count of buffered rows will equal specified batch size.

DataProtectors() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors

DataProtectors.RowToTokenizedRow<T> - Class in org.apache.beam.examples.complete.datatokenization.transforms

The DataProtectors.RowToTokenizedRow transform converts Row to TableRow objects.

DataProtectors.RowToTokenizedRow.Builder<T> - Class in org.apache.beam.examples.complete.datatokenization.transforms

Builder for DataProtectors.RowToTokenizedRow.

DataProtectors.TokenizationFn - Class in org.apache.beam.examples.complete.datatokenization.transforms

Class implements stateful doFn for data tokenization using remote RPC.

datasetId - Variable in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

DataTokenization - Class in org.apache.beam.examples.complete.datatokenization

The DataTokenization pipeline reads data from one of the supported sources, tokenizes data with external API calls to some tokenization server, and writes data into one of the supported sinks.

DataTokenization() - Constructor for class org.apache.beam.examples.complete.datatokenization.DataTokenization

DataTokenizationOptions - Interface in org.apache.beam.examples.complete.datatokenization.options

The DataTokenizationOptions interface provides the custom execution options passed by the executor at the command-line.

DATE_TIME_FORMATTER - Static variable in class org.apache.beam.examples.complete.game.utils.GameConstants

DEADLETTER_SCHEMA - Static variable in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

DeadLetterBigQuery() - Constructor for class org.apache.beam.examples.snippets.Snippets.DeadLetterBigQuery

DebuggingWordCount - Class in org.apache.beam.examples

An example that verifies word counts in Shakespeare and includes Beam best practices.

DebuggingWordCount() - Constructor for class org.apache.beam.examples.DebuggingWordCount

DebuggingWordCount.FilterTextFn - Class in org.apache.beam.examples

A DoFn that filters for a specific key based upon a regular expression.

DebuggingWordCount.WordCountOptions - Interface in org.apache.beam.examples

Options supported by DebuggingWordCount.

decode(InputStream) - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

DefaultToCurrentSystemTime() - Constructor for class org.apache.beam.examples.WindowedWordCount.DefaultToCurrentSystemTime

DefaultToMinTimestampPlusOneHour() - Constructor for class org.apache.beam.examples.WindowedWordCount.DefaultToMinTimestampPlusOneHour

delimiter - Variable in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.FailsafeElementToJsonFn

delimiter() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

delimiter() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

DelimiterFactory() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.DelimiterFactory

deserialize(String, byte[]) - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClassKafkaAvroDeserializer

DistinctExample - Class in org.apache.beam.examples.cookbook

This example uses as input text of King Lear, by William Shakespeare as plaintext files, and will remove any duplicate lines from this file.

DistinctExample() - Constructor for class org.apache.beam.examples.cookbook.DistinctExample

DistinctExample.Options - Interface in org.apache.beam.examples.cookbook

Options supported by DistinctExample.

DistinctExample.Options.OutputFactory - Class in org.apache.beam.examples.cookbook

Returns gs://${TEMP_LOCATION}/"deduped.txt".

DurationUtils - Class in org.apache.beam.examples.complete.datatokenization.utils

The DurationUtils class provides common utilities for manipulating and formatting Duration objects.

DurationUtils() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.DurationUtils

E

EchoInputDoFn(SubProcessConfiguration, String) - Constructor for class org.apache.beam.examples.subprocess.ExampleEchoPipeline.EchoInputDoFn

encode(FailsafeElement<OriginalT, CurrentT>, OutputStream) - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

ErrorConverters - Class in org.apache.beam.examples.complete.datatokenization.utils

Transforms & DoFns & Options for Teleport Error logging.

ErrorConverters() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters

ErrorConverters.FailedStringToCsvRowFn - Class in org.apache.beam.examples.complete.datatokenization.utils

The ErrorConverters.FailedStringToCsvRowFn converts string objects which have failed processing into String objects contained CSV which can be output to a filesystem.

ErrorConverters.FailedStringToTableRowFn - Class in org.apache.beam.examples.complete.datatokenization.utils

The ErrorConverters.FailedStringToTableRowFn converts string objects which have failed processing into TableRow objects which can be output to a dead-letter table.

ErrorConverters.WriteErrorsToTextIO<T,V> - Class in org.apache.beam.examples.complete.datatokenization.utils

ErrorConverters.WriteErrorsToTextIO is a PTransform that writes strings error messages to file system using TextIO and custom line format SerializableFunction to convert errors in necessary format.

ErrorConverters.WriteErrorsToTextIO.Builder<T,V> - Class in org.apache.beam.examples.complete.datatokenization.utils

Builder for ErrorConverters.WriteErrorsToTextIO.

ErrorConverters.WriteStringMessageErrors - Class in org.apache.beam.examples.complete.datatokenization.utils

Write errors as string encoded messages.

ErrorConverters.WriteStringMessageErrors.Builder - Class in org.apache.beam.examples.complete.datatokenization.utils

Builder for ErrorConverters.WriteStringMessageErrors.

ErrorConverters.WriteStringMessageErrorsAsCsv - Class in org.apache.beam.examples.complete.datatokenization.utils

Writes all Errors to GCS, place at the end of your pipeline.

ErrorConverters.WriteStringMessageErrorsAsCsv.Builder - Class in org.apache.beam.examples.complete.datatokenization.utils

Builder for ErrorConverters.WriteStringMessageErrorsAsCsv.

errorWritePath() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

errorWritePath() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

ExampleBigQueryTableOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure BigQuery tables in Beam examples.

ExampleBigQueryTableOptions.BigQueryTableFactory - Class in org.apache.beam.examples.common

Returns the job name as the default BigQuery table name.

ExampleEchoPipeline - Class in org.apache.beam.examples.subprocess

In this example batch pipeline we will invoke a simple Echo C++ library within a DoFn The sample makes use of a ExternalLibraryDoFn class which abstracts the setup and processing of the executable, logs and results.

ExampleEchoPipeline() - Constructor for class org.apache.beam.examples.subprocess.ExampleEchoPipeline

ExampleEchoPipeline.EchoInputDoFn - Class in org.apache.beam.examples.subprocess

Simple DoFn that echos the element, used as an example of running a C++ library.

ExampleOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure the Beam examples.

ExamplePubsubTopicAndSubscriptionOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure Pub/Sub topic/subscription in Beam examples.

ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory - Class in org.apache.beam.examples.common

Returns a default Pub/Sub subscription based on the project and the job names.

ExamplePubsubTopicOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure Pub/Sub topic in Beam examples.

ExamplePubsubTopicOptions.PubsubTopicFactory - Class in org.apache.beam.examples.common

Returns a default Pub/Sub topic based on the project and the job names.

ExampleUtils - Class in org.apache.beam.examples.common

The utility class that sets up and tears down external resources, and cancels the streaming pipelines once the program terminates.

ExampleUtils(PipelineOptions) - Constructor for class org.apache.beam.examples.common.ExampleUtils

Do resources and runner options setup.

exec(SubProcessCommandLineArgs) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessKernel

execBinaryResult(SubProcessCommandLineArgs) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessKernel

ExecutableFile - Class in org.apache.beam.examples.subprocess.utils

Contains the configuration for the external library.

ExecutableFile(SubProcessConfiguration, String) - Constructor for class org.apache.beam.examples.subprocess.utils.ExecutableFile

expand(PCollection<String>) - Method in class org.apache.beam.examples.common.WriteOneFilePerWindow

expand(PCollection<String>) - Method in class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

expand(PCollection<KV<Integer, Row>>) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

expand(PCollection<String>) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.JsonToBeamRow

expand(PCollectionTuple) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

expand(PBegin) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

expand(PCollection<FailsafeElement<T, V>>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

expand(PCollection<FailsafeElement<String, String>>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors

expand(PCollection<FailsafeElement<String, String>>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

expand(PCollection<KV<String, Integer>>) - Method in class org.apache.beam.examples.complete.game.GameStats.CalculateSpammyUsers

expand(PCollection<UserScore.GameActionInfo>) - Method in class org.apache.beam.examples.complete.game.UserScore.ExtractAndSumScore

expand(PCollection<InputT>) - Method in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

expand(PCollection<InputT>) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText

expand(PCollection<String>) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText.WriteOneFilePerWindow

expand(PCollection<T>) - Method in class org.apache.beam.examples.complete.game.utils.WriteWindowedToBigQuery

expand(PCollection<String>) - Method in class org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform.FormatOutput

expand(PCollection<KV<URI, String>>) - Method in class org.apache.beam.examples.complete.TfIdf.ComputeTfIdf

expand(PBegin) - Method in class org.apache.beam.examples.complete.TfIdf.ReadDocuments

expand(PCollection<KV<String, KV<URI, Double>>>) - Method in class org.apache.beam.examples.complete.TfIdf.WriteTfIdf

expand(PCollection<String>) - Method in class org.apache.beam.examples.WordCount.CountWords

F

FailedStringToCsvRowFn(String) - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.FailedStringToCsvRowFn

FailedStringToCsvRowFn() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.FailedStringToCsvRowFn

FailedStringToTableRowFn() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.FailedStringToTableRowFn

FAILSAFE_ELEMENT_CODER - Static variable in class org.apache.beam.examples.complete.datatokenization.DataTokenization

String/String Coder for FailsafeElement.

FailsafeElement<OriginalT,CurrentT> - Class in org.apache.beam.examples.complete.datatokenization.utils

The FailsafeElement class holds the current value and original value of a record within a pipeline.

FailsafeElementCoder<OriginalT,CurrentT> - Class in org.apache.beam.examples.complete.datatokenization.utils

The FailsafeElementCoder encodes and decodes FailsafeElement objects.

failureTag() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

fieldFn - Variable in class org.apache.beam.examples.complete.game.utils.WriteToText

fieldInfo - Variable in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

FieldInfo(String, WriteToBigQuery.FieldFn<InputT>) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToBigQuery.FieldInfo

filenamePrefix - Variable in class org.apache.beam.examples.complete.game.utils.WriteToText

filenamePrefixForWindow(IntervalWindow) - Method in class org.apache.beam.examples.common.WriteOneFilePerWindow.PerWindowFiles

filenamePrefixForWindow(IntervalWindow) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText.PerWindowFiles

fileProcessPattern() - Static method in class org.apache.beam.examples.snippets.Snippets

FileUtils - Class in org.apache.beam.examples.subprocess.utils

Utilities for dealing with movement of files from object stores and workers.

FileUtils() - Constructor for class org.apache.beam.examples.subprocess.utils.FileUtils

FilterExamples - Class in org.apache.beam.examples.cookbook

This is an example that demonstrates several approaches to filtering, and use of the Mean transform.

FilterExamples() - Constructor for class org.apache.beam.examples.cookbook.FilterExamples

FilterExamples.Options - Interface in org.apache.beam.examples.cookbook

Options supported by FilterExamples.

FilterTextFn(String) - Constructor for class org.apache.beam.examples.DebuggingWordCount.FilterTextFn

FIVE_MINUTES - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

FormatAsTextFn() - Constructor for class org.apache.beam.examples.multilanguage.PythonDataframeWordCount.FormatAsTextFn

FormatAsTextFn() - Constructor for class org.apache.beam.examples.WordCount.FormatAsTextFn

formatCoGbkResults(String, Iterable<String>, Iterable<String>) - Static method in class org.apache.beam.examples.snippets.Snippets

Helper function to format results in coGroupByKeyTuple.

FormatOutput(KafkaToPubsubOptions) - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform.FormatOutput

FormatTransform - Class in org.apache.beam.examples.complete.kafkatopubsub.transforms

Different transformations over the processed data in the pipeline.

FormatTransform() - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform

FormatTransform.FORMAT - Enum in org.apache.beam.examples.complete.kafkatopubsub.transforms

FormatTransform.FormatOutput - Class in org.apache.beam.examples.complete.kafkatopubsub.transforms

The FormatTransform.FormatOutput wraps a String serializable messages with the PubsubMessage class.

G

GameConstants - Class in org.apache.beam.examples.complete.game.utils

Shared constants between game series classes.

GameConstants() - Constructor for class org.apache.beam.examples.complete.game.utils.GameConstants

GameStats - Class in org.apache.beam.examples.complete.game

This class is the fourth in a series of four pipelines that tell a story in a 'gaming' domain, following UserScore, HourlyTeamScore, and LeaderBoard.

GameStats() - Constructor for class org.apache.beam.examples.complete.game.GameStats

GameStats.CalculateSpammyUsers - Class in org.apache.beam.examples.complete.game

Filter out all users but those with a high clickrate, which we will consider as 'spammy' users.

GameStats.Options - Interface in org.apache.beam.examples.complete.game

Options supported by GameStats.

getAllowedLateness() - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

getBatchSize() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getBeamSchema() - Method in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

getBigQueryDataset() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getBigQuerySchema() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getBigQuerySchema() - Method in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

getBigQueryTable() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getBigQueryTableName() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getBigTableColumnFamilyName() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

getBigTableInstanceId() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

getBigTableKeyColumnName() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

getBigTableProjectId() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

getBigTableTableId() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

getBootstrapServers() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getCoderArguments() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

getConcurrency() - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

getConcurrency() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getContainsHeaders() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getCreateDisposition() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getCsvContainsHeaders() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getCsvDelimiter() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getCsvErrorConverter() - Static method in class org.apache.beam.examples.complete.datatokenization.transforms.SerializableFunctions

getCsvFormat() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getCsvFormat() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getCsvFormat(String, String) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters

Gets Csv format accoring to Apache Commons CSV.

getCsvFromRow(Row) - Method in class org.apache.beam.examples.complete.datatokenization.utils.RowToCsv

getCurrentPayloadCoder() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

getDataSchemaPath() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getDataset() - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

getDatastoreAncestorKey() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getDeadletterTable() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getDefaultWindowMappingFn() - Method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

getDelimiter() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getDestinationLocation() - Method in class org.apache.beam.examples.subprocess.utils.ExecutableFile

getEncodedTypeDescriptor() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

getErrFile() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

getErrFileLocation() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

getErrorMessage() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

getErrorRecordsTable() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors

getErrorRecordsTableSchema() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors

getExpansionService() - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

Set this option to specify Python expansion service URL.

getExpansionService() - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

Set this option to specify Python expansion service URL.

getExpectedChecksum() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getField1() - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

getField2() - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

getField3() - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

getFileResourceId(String, String) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

getFilterPattern() - Method in interface org.apache.beam.examples.DebuggingWordCount.WordCountOptions

getFixedWindowDuration() - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

getGameStatsTablePrefix() - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

getGcsFileAsLocal(String, String) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.SslConsumerFactoryFn

Reads a file from GCS and writes it locally.

getGcsFileAsString(String) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

Reads a file from GCS and returns it as a string.

getInjectorNumWorkers() - Method in interface org.apache.beam.examples.common.ExampleOptions

getInput() - Method in interface org.apache.beam.examples.complete.game.UserScore.Options

getInput() - Method in interface org.apache.beam.examples.complete.TfIdf.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.CombinePerKeyExamples.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.DistinctExample.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.MaxPerKeyExamples.Options

getInput() - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

getInput() - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

getInputFile() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getInputFile() - Method in interface org.apache.beam.examples.complete.StreamingWordExtract.StreamingWordExtractOptions

getInputFile() - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

getInputFile() - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

getInputFile() - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

By default, this example reads from a public dataset containing the text of King Lear.

getInputFile() - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

By default, this example reads from a public dataset containing the text of King Lear.

getInputFileFormat() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getInputFilePattern() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getInputFileSpec() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getInputQuery() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getInputTopics() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getJsonBeamSchema() - Method in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

getJsonSchemaPath() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getKafkaConsumerConfig() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getKafkaCredentialsFromVault(String, String) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

Retrieves all credentials from HashiCorp Vault secret storage.

getKeepJobsRunning() - Method in interface org.apache.beam.examples.common.ExampleOptions

getKey() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs.Command

getKeyPassword() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getKeystorePassword() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getKeystorePath() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getKind() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getLargeNumFiles() - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

getLeaderBoardTableName() - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

getMaxTimestampMillis() - Method in interface org.apache.beam.examples.WindowedWordCount.Options

getMinTimestampMillis() - Method in interface org.apache.beam.examples.WindowedWordCount.Options

getModelPath() - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

getMonthFilter() - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

getNonTokenizedDeadLetterPath() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getNumShards() - Method in interface org.apache.beam.examples.WindowedWordCount.Options

getOnlyUpLoadLogsOnError() - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

getOnlyUpLoadLogsOnError() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getOriginalPayload() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

getOriginalPayloadCoder() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

getOutFile() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

getOutFileLocation() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

getOutput() - Method in interface org.apache.beam.examples.complete.game.UserScore.Options

getOutput() - Method in interface org.apache.beam.examples.complete.TfIdf.Options

getOutput() - Method in interface org.apache.beam.examples.complete.TopWikipediaSessions.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.CombinePerKeyExamples.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.DistinctExample.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.JoinExamples.Options

getOutput() - Method in interface org.apache.beam.examples.cookbook.MaxPerKeyExamples.Options

getOutput() - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

Set this required option to specify where to write the output.

getOutput() - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

getOutput() - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

Set this required option to specify where to write the output.

getOutputDirectory() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getOutputFileFormat() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getOutputFormat() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getOutputProject() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getOutputToBigQuery() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getOutputToChecksum() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getOutputToDatastore() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getOutputTopic() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getParameters() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs

getPayload() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

getPubsubSubscription() - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions

getPubsubTopic() - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicOptions

getPubsubTopic() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getReadMethod() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getRecursive() - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

getResultFile() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

getRpcUri() - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

getSchema() - Method in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

Build the output table schema.

getSecretStoreUrl() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getSessionGap() - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

getSourceGCSLocation() - Method in class org.apache.beam.examples.subprocess.utils.ExecutableFile

getSourcePath() - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

getSourcePath() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getStacktrace() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

getStartMin() - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

getStopMin() - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

getStringValue() - Method in interface org.apache.beam.examples.snippets.Snippets.MyOptions

getSubProcessConfiguration() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getTeamWindowDuration() - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

getThresholdScore() - Method in interface org.apache.beam.examples.complete.game.StatefulTeamScore.Options

getTopic() - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

getTruststorePassword() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getTruststorePath() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getUserActivityWindowDuration() - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

getValue() - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs.Command

getVaultToken() - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

getWaitTime() - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

getWaitTime() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getWikiInput() - Method in interface org.apache.beam.examples.complete.TopWikipediaSessions.Options

getWindowDuration() - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

getWindowDuration() - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

getWindowDuration() - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

getWindowDuration() - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

getWindowDuration() - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

getWindowSize() - Method in interface org.apache.beam.examples.WindowedWordCount.Options

getWindowSlideEvery() - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

getWindowSlideEvery() - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

getWorkerPath() - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

getWorkerPath() - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

getWriteDisposition() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

getWriteMethod() - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

H

hashCode() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

hasHeaders() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

headerTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

headerTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

HourlyTeamScore - Class in org.apache.beam.examples.complete.game

This class is the second in a series of four pipelines that tell a story in a 'gaming' domain, following UserScore.

HourlyTeamScore() - Constructor for class org.apache.beam.examples.complete.game.HourlyTeamScore

HourlyTeamScore.Options - Interface in org.apache.beam.examples.complete.game

Options supported by HourlyTeamScore.

I

ID_FIELD_NAME - Static variable in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors

initialize(HttpRequest) - Method in class org.apache.beam.examples.complete.game.injector.RetryHttpInitializerWrapper

Initializes the given request.

initSemaphore(Integer, String) - Static method in class org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils

inputFileSpec() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

InsertDelays() - Constructor for class org.apache.beam.examples.cookbook.TriggerExample.InsertDelays

isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

isSslSpecified(KafkaToPubsubOptions) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

J

JoinExamples - Class in org.apache.beam.examples.cookbook

This example shows how to do a join on two collections.

JoinExamples() - Constructor for class org.apache.beam.examples.cookbook.JoinExamples

JoinExamples.Options - Interface in org.apache.beam.examples.cookbook

Options supported by JoinExamples.

jsonSchema - Variable in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.FailsafeElementToJsonFn

jsonSchema() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

jsonSchemaPath() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

JsonToBeamRow - Class in org.apache.beam.examples.complete.datatokenization.transforms

The JsonToBeamRow converts jsons string to beam rows.

JsonToBeamRow(String, SchemasUtils) - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.JsonToBeamRow

K

KAFKA_CREDENTIALS - Static variable in class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

KafkaPubsubConstants - Class in org.apache.beam.examples.complete.kafkatopubsub

Constant variables that are used across the template's parts.

KafkaPubsubConstants() - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

KafkaToPubsub - Class in org.apache.beam.examples.complete.kafkatopubsub

The KafkaToPubsub pipeline is a streaming pipeline which ingests data in JSON format from Kafka, and outputs the resulting records to PubSub.

KafkaToPubsub() - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsub

KafkaToPubsubOptions - Interface in org.apache.beam.examples.complete.kafkatopubsub.options

KafkaWordCountAvro - Class in org.apache.beam.examples

KafkaWordCountAvro() - Constructor for class org.apache.beam.examples.KafkaWordCountAvro

KafkaWordCountJson - Class in org.apache.beam.examples

KafkaWordCountJson() - Constructor for class org.apache.beam.examples.KafkaWordCountJson

L

LeaderBoard - Class in org.apache.beam.examples.complete.game

This class is the third in a series of four pipelines that tell a story in a 'gaming' domain, following UserScore and HourlyTeamScore.

LeaderBoard() - Constructor for class org.apache.beam.examples.complete.game.LeaderBoard

LeaderBoard.Options - Interface in org.apache.beam.examples.complete.game

Options supported by LeaderBoard.

lineTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

lineTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

LineToFailsafeJson() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

listInputDocuments(TfIdf.Options) - Static method in class org.apache.beam.examples.complete.TfIdf

Lists documents contained beneath the options.input prefix/directory.

M

main(String[]) - Static method in class org.apache.beam.examples.complete.AutoComplete

main(String[]) - Static method in class org.apache.beam.examples.complete.datatokenization.DataTokenization

Main entry point for pipeline execution.

main(String[]) - Static method in class org.apache.beam.examples.complete.game.GameStats

main(String[]) - Static method in class org.apache.beam.examples.complete.game.HourlyTeamScore

Run a batch pipeline to do windowed analysis of the data.

main(String[]) - Static method in class org.apache.beam.examples.complete.game.LeaderBoard

main(String[]) - Static method in class org.apache.beam.examples.complete.game.StatefulTeamScore

main(String[]) - Static method in class org.apache.beam.examples.complete.game.UserScore

Run a batch pipeline.

main(String[]) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsub

Main entry point for pipeline execution.

main(String[]) - Static method in class org.apache.beam.examples.complete.StreamingWordExtract

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.complete.TfIdf

main(String[]) - Static method in class org.apache.beam.examples.complete.TopWikipediaSessions

main(String[]) - Static method in class org.apache.beam.examples.complete.TrafficMaxLaneFlow

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.complete.TrafficRoutes

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.cookbook.BigQueryTornadoes

main(String[]) - Static method in class org.apache.beam.examples.cookbook.CombinePerKeyExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.DistinctExample

main(String[]) - Static method in class org.apache.beam.examples.cookbook.FilterExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.JoinExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.MaxPerKeyExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.TriggerExample

main(String[]) - Static method in class org.apache.beam.examples.DebuggingWordCount

main(String[]) - Static method in class org.apache.beam.examples.KafkaWordCountAvro

main(String[]) - Static method in class org.apache.beam.examples.KafkaWordCountJson

main(String[]) - Static method in class org.apache.beam.examples.MinimalWordCount

main(String[]) - Static method in class org.apache.beam.examples.multilanguage.PythonDataframeWordCount

main(String[]) - Static method in class org.apache.beam.examples.multilanguage.SklearnMnistClassification

main(String[]) - Static method in class org.apache.beam.examples.snippets.Snippets.CustomSessionPipeline

main(String[]) - Static method in class org.apache.beam.examples.snippets.Snippets.DeadLetterBigQuery

main(Pipeline) - Static method in class org.apache.beam.examples.snippets.Snippets.NaturalLanguageIntegration

main(Pipeline, Instant, Instant, Duration, Duration, String) - Static method in class org.apache.beam.examples.snippets.Snippets.PeriodicallyUpdatingSideInputs

main(Pipeline, List<Row>, List<Row>, Schema, Schema) - Static method in class org.apache.beam.examples.snippets.Snippets.SchemaJoinPattern

main(String[]) - Static method in class org.apache.beam.examples.subprocess.ExampleEchoPipeline

main(String[]) - Static method in class org.apache.beam.examples.WindowedWordCount

main(String[]) - Static method in class org.apache.beam.examples.WordCount

MaxFlow() - Constructor for class org.apache.beam.examples.complete.TrafficMaxLaneFlow.MaxFlow

MaxPerKeyExamples - Class in org.apache.beam.examples.cookbook

An example that reads the public samples of weather data from BigQuery, and finds the maximum temperature ('mean_temp') for each month.

MaxPerKeyExamples() - Constructor for class org.apache.beam.examples.cookbook.MaxPerKeyExamples

MaxPerKeyExamples.Options - Interface in org.apache.beam.examples.cookbook

Options supported by MaxPerKeyExamples.

mergeWindows(WindowFn<TableRow, IntervalWindow>.MergeContext) - Method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

MinimalWordCount - Class in org.apache.beam.examples

An example that counts words in Shakespeare.

MinimalWordCount() - Constructor for class org.apache.beam.examples.MinimalWordCount

modelBigQueryIO(Pipeline) - Static method in class org.apache.beam.examples.snippets.Snippets

Using a Read and Write transform to read/write from/to BigQuery.

modelBigQueryIO(Pipeline, String, String, String) - Static method in class org.apache.beam.examples.snippets.Snippets

N

NaturalLanguageIntegration() - Constructor for class org.apache.beam.examples.snippets.Snippets.NaturalLanguageIntegration

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors

newBuilder() - Static method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

O

of(OriginalT, CurrentT) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

of(FailsafeElement<OriginalT, CurrentT>) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

of(Coder<OriginalT>, Coder<CurrentT>) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElementCoder

ONE_DAY - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

ONE_MINUTE - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

onlyUpLoadLogsOnError - Variable in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

org.apache.beam.examples - package org.apache.beam.examples

org.apache.beam.examples.common - package org.apache.beam.examples.common

org.apache.beam.examples.complete - package org.apache.beam.examples.complete

org.apache.beam.examples.complete.datatokenization - package org.apache.beam.examples.complete.datatokenization

Protegrity Data Tokenization template for Google Cloud Teleport.

org.apache.beam.examples.complete.datatokenization.options - package org.apache.beam.examples.complete.datatokenization.options

Protegrity Data Tokenization template for Google Cloud Teleport.

org.apache.beam.examples.complete.datatokenization.transforms - package org.apache.beam.examples.complete.datatokenization.transforms

Protegrity Data Tokenization template for Google Cloud Teleport.

org.apache.beam.examples.complete.datatokenization.transforms.io - package org.apache.beam.examples.complete.datatokenization.transforms.io

Protegrity Data Tokenization template for Google Cloud Teleport.

org.apache.beam.examples.complete.datatokenization.utils - package org.apache.beam.examples.complete.datatokenization.utils

Protegrity Data Tokenization template for Google Cloud Teleport.

org.apache.beam.examples.complete.game - package org.apache.beam.examples.complete.game

org.apache.beam.examples.complete.game.injector - package org.apache.beam.examples.complete.game.injector

org.apache.beam.examples.complete.game.utils - package org.apache.beam.examples.complete.game.utils

org.apache.beam.examples.complete.kafkatopubsub - package org.apache.beam.examples.complete.kafkatopubsub

Kafka to Pubsub template.

org.apache.beam.examples.complete.kafkatopubsub.avro - package org.apache.beam.examples.complete.kafkatopubsub.avro

Kafka to Pubsub template.

org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer - package org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer

Kafka to Pubsub template.

org.apache.beam.examples.complete.kafkatopubsub.options - package org.apache.beam.examples.complete.kafkatopubsub.options

Kafka to Pubsub template.

org.apache.beam.examples.complete.kafkatopubsub.transforms - package org.apache.beam.examples.complete.kafkatopubsub.transforms

Kafka to Pubsub template.

org.apache.beam.examples.cookbook - package org.apache.beam.examples.cookbook

org.apache.beam.examples.multilanguage - package org.apache.beam.examples.multilanguage

org.apache.beam.examples.snippets - package org.apache.beam.examples.snippets

org.apache.beam.examples.subprocess - package org.apache.beam.examples.subprocess

org.apache.beam.examples.subprocess.configuration - package org.apache.beam.examples.subprocess.configuration

org.apache.beam.examples.subprocess.kernel - package org.apache.beam.examples.subprocess.kernel

org.apache.beam.examples.subprocess.utils - package org.apache.beam.examples.subprocess.utils

OutputFactory() - Constructor for class org.apache.beam.examples.cookbook.DistinctExample.Options.OutputFactory

P

parseDuration(String) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.DurationUtils

Parses a duration from a period formatted string.

parseKafkaConsumerConfig(String) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

PASSWORD - Static variable in class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

PeriodicallyUpdatingSideInputs() - Constructor for class org.apache.beam.examples.snippets.Snippets.PeriodicallyUpdatingSideInputs

Permit(String) - Constructor for class org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils.Permit

PerWindowFiles(ResourceId) - Constructor for class org.apache.beam.examples.common.WriteOneFilePerWindow.PerWindowFiles

PerWindowFiles(ResourceId) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToText.PerWindowFiles

PlaceholderExternalService() - Constructor for class org.apache.beam.examples.snippets.Snippets.PlaceholderExternalService

process(KV<Integer, Iterable<Row>>, DoFn<KV<Integer, Iterable<Row>>, Row>.ProcessContext) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.TokenizationFn

processElement(DoFn<Row, TableRow>.ProcessContext) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigQueryIO.RowToTableRowFn

processElement(DoFn<FailsafeElement<String, String>, FailsafeElement<String, String>>.ProcessContext) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.FailsafeElementToJsonFn

processElement(DoFn<FailsafeElement<String, String>, String>.ProcessContext) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.FailedStringToCsvRowFn

processElement(DoFn<FailsafeElement<String, String>, TableRow>.ProcessContext) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.FailedStringToTableRowFn

processElement(DoFn<KV<String, UserScore.GameActionInfo>, KV<String, Integer>>.ProcessContext, ValueState<Integer>) - Method in class org.apache.beam.examples.complete.game.StatefulTeamScore.UpdateTeamScoreFn

To use a state cell, annotate a parameter with DoFn.StateId that matches the state declaration.

processElement(DoFn<InputT, TableRow>.ProcessContext, BoundedWindow) - Method in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery.BuildRowFn

processElement(DoFn<InputT, String>.ProcessContext, BoundedWindow) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText.BuildRowFn

processElement(DoFn<T, TableRow>.ProcessContext, BoundedWindow) - Method in class org.apache.beam.examples.complete.game.utils.WriteWindowedToBigQuery.BuildRowFn

processElement(DoFn<String, String>.ProcessContext) - Method in class org.apache.beam.examples.cookbook.TriggerExample.InsertDelays

processElement(DoFn<KV<String, Long>, KV<String, Long>>.ProcessContext) - Method in class org.apache.beam.examples.DebuggingWordCount.FilterTextFn

processElement(DoFn<KV<String, String>, KV<String, String>>.ProcessContext) - Method in class org.apache.beam.examples.subprocess.ExampleEchoPipeline.EchoInputDoFn

projectId - Variable in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

PubsubSubscriptionFactory() - Constructor for class org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory

PubsubTopicFactory() - Constructor for class org.apache.beam.examples.common.ExamplePubsubTopicOptions.PubsubTopicFactory

putCommand(SubProcessCommandLineArgs.Command) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs

PythonDataframeWordCount - Class in org.apache.beam.examples.multilanguage

An example that counts words in Shakespeare and utilizes a Python external transform.

PythonDataframeWordCount() - Constructor for class org.apache.beam.examples.multilanguage.PythonDataframeWordCount

PythonDataframeWordCount.FormatAsTextFn - Class in org.apache.beam.examples.multilanguage

A SimpleFunction that converts a counted row into a printable string.

PythonDataframeWordCount.WordCountOptions - Interface in org.apache.beam.examples.multilanguage

Options supported by PythonDataframeWordCount.

R

read(Pipeline, SchemasUtils) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO

readAvrosFromKafka(String, List<String>, Map<String, Object>, Map<String, String>) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform

Configures Kafka consumer to read avros to AvroDataClass format.

ReadCsv() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

ReadDocuments(Iterable<URI>) - Constructor for class org.apache.beam.examples.complete.TfIdf.ReadDocuments

readFromKafka(String, List<String>, Map<String, Object>, Map<String, String>) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform

Configures Kafka consumer.

readGcsFile(String) - Static method in class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

Method to read a schema file from GCS and return the file contents as a string.

readLineOfLogFile(Path) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

readTestData(Instant) - Static method in class org.apache.beam.examples.snippets.Snippets.PlaceholderExternalService

RetryHttpInitializerWrapper - Class in org.apache.beam.examples.complete.game.injector

RetryHttpInitializerWrapper will automatically retry upon RPC failures, preserving the auto-refresh behavior of the Google Credentials.

RetryHttpInitializerWrapper(Credential) - Constructor for class org.apache.beam.examples.complete.game.injector.RetryHttpInitializerWrapper

A constructor.

RowToCsv - Class in org.apache.beam.examples.complete.datatokenization.utils

The RowToCsv class to convert Beam Rows into strings in CSV format.

RowToCsv(String) - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.RowToCsv

RowToTableRowFn() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigQueryIO.RowToTableRowFn

RowToTokenizedRow() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

rpcURI() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

run(DataTokenizationOptions) - Static method in class org.apache.beam.examples.complete.datatokenization.DataTokenization

Runs the pipeline to completion with the specified options.

run(Pipeline, KafkaToPubsubOptions) - Static method in class org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsub

Runs a pipeline which reads message from Kafka and writes it to GCS.

run(TopWikipediaSessions.Options) - Static method in class org.apache.beam.examples.complete.TopWikipediaSessions

runAutocompletePipeline(AutoComplete.Options) - Static method in class org.apache.beam.examples.complete.AutoComplete

runBigQueryTornadoes(BigQueryTornadoes.Options) - Static method in class org.apache.beam.examples.cookbook.BigQueryTornadoes

runTrafficMaxLaneFlow(TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions) - Static method in class org.apache.beam.examples.complete.TrafficMaxLaneFlow

runTrafficRoutes(TrafficRoutes.TrafficRoutesOptions) - Static method in class org.apache.beam.examples.complete.TrafficRoutes

S

schema() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

SchemaJoinPattern() - Constructor for class org.apache.beam.examples.snippets.Snippets.SchemaJoinPattern

SchemasUtils - Class in org.apache.beam.examples.complete.datatokenization.utils

The SchemasUtils Class to read JSON based schema.

SchemasUtils(String) - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

SchemasUtils(String, Charset) - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

SerializableFunctions - Class in org.apache.beam.examples.complete.datatokenization.transforms

The SerializableFunctions class to store static Serializable functions.

SerializableFunctions() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.SerializableFunctions

setAllowedLateness(Integer) - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

setBatchSize(Integer) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setBatchSize(int) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

setBigQueryDataset(String) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setBigQuerySchema(TableSchema) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setBigQueryTable(String) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setBigQueryTableName(String) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setBigTableColumnFamilyName(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

setBigTableInstanceId(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

setBigTableKeyColumnName(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

setBigTableProjectId(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

setBigTableTableId(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO.BigTableOptions

setBootstrapServers(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setConcurrency(Integer) - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

setConcurrency(Integer) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setContainsHeaders(Boolean) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setCreateDisposition(BigQueryIO.Write.CreateDisposition) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setCsvContainsHeaders(Boolean) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setCsvDelimiter(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setCsvDelimiter(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder

setCsvFormat(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setCsvFormat(String) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setCsvFormat(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setDataSchemaPath(String) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setDataset(String) - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

setDatastoreAncestorKey(String) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setDeadletterTable(String) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setDelimiter(String) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setDelimiter(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setDelimiter(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setDestinationLocation(String) - Method in class org.apache.beam.examples.subprocess.utils.ExecutableFile

setErrorMessage(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

setErrorRecordsTable(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors.Builder

setErrorRecordsTableSchema(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors.Builder

setErrorWritePath(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO.Builder

setErrorWritePath(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder

setExpansionService(String) - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

setExpansionService(String) - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

setExpectedChecksum(Long) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setFailureTag(TupleTag<FailsafeElement<Row, Row>>) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

setField1(String) - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

setField2(Float) - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

setField3(Float) - Method in class org.apache.beam.examples.complete.kafkatopubsub.avro.AvroDataClass

setFilterPattern(String) - Method in interface org.apache.beam.examples.DebuggingWordCount.WordCountOptions

setFixedWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

setGameStatsTablePrefix(String) - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

setHasHeaders(Boolean) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setHeaderTag(TupleTag<String>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setHeaderTag(TupleTag<String>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setInjectorNumWorkers(int) - Method in interface org.apache.beam.examples.common.ExampleOptions

setInput(String) - Method in interface org.apache.beam.examples.complete.game.UserScore.Options

setInput(String) - Method in interface org.apache.beam.examples.complete.TfIdf.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.CombinePerKeyExamples.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.DistinctExample.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.MaxPerKeyExamples.Options

setInput(String) - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

setInput(String) - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

setInputFile(String) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setInputFile(String) - Method in interface org.apache.beam.examples.complete.StreamingWordExtract.StreamingWordExtractOptions

setInputFile(String) - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

setInputFile(String) - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

setInputFile(String) - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

setInputFile(String) - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

setInputFileFormat(TokenizationFileSystemIO.FORMAT) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setInputFilePattern(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setInputFileSpec(String) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setInputFileSpec(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setInputQuery(String) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setInputTopics(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setJsonSchema(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setJsonSchemaPath(String) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setJsonSchemaPath(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setKafkaConsumerConfig(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setKeepJobsRunning(boolean) - Method in interface org.apache.beam.examples.common.ExampleOptions

setKey(int) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs.Command

setKeyPassword(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setKeystorePassword(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setKeystorePath(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setKind(String) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setLargeNumFiles(Boolean) - Method in interface org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.CsvPipelineOptions

setLeaderBoardTableName(String) - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

setLineTag(TupleTag<String>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setLineTag(TupleTag<String>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv.Builder

setMaxTimestampMillis(Long) - Method in interface org.apache.beam.examples.WindowedWordCount.Options

setMinTimestampMillis(Long) - Method in interface org.apache.beam.examples.WindowedWordCount.Options

setModelPath(String) - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

setMonthFilter(Integer) - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

setNonTokenizedDeadLetterPath(String) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setNumShards(Integer) - Method in interface org.apache.beam.examples.WindowedWordCount.Options

setOnlyUpLoadLogsOnError(Boolean) - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

setOnlyUpLoadLogsOnError(Boolean) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setOutput(String) - Method in interface org.apache.beam.examples.complete.game.UserScore.Options

setOutput(String) - Method in interface org.apache.beam.examples.complete.TfIdf.Options

setOutput(String) - Method in interface org.apache.beam.examples.complete.TopWikipediaSessions.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.CombinePerKeyExamples.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.DistinctExample.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.FilterExamples.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.JoinExamples.Options

setOutput(String) - Method in interface org.apache.beam.examples.cookbook.MaxPerKeyExamples.Options

setOutput(String) - Method in interface org.apache.beam.examples.multilanguage.PythonDataframeWordCount.WordCountOptions

setOutput(String) - Method in interface org.apache.beam.examples.multilanguage.SklearnMnistClassification.SklearnMnistClassificationOptions

setOutput(String) - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

setOutputDirectory(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setOutputFileFormat(TokenizationFileSystemIO.FORMAT) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setOutputFormat(FormatTransform.FORMAT) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setOutputProject(String) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setOutputToBigQuery(Boolean) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setOutputToChecksum(Boolean) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setOutputToDatastore(Boolean) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setOutputTopic(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setPubsubSubscription(String) - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions

setPubsubTopic(String) - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicOptions

setPubsubTopic(String) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setReadMethod(BigQueryIO.TypedRead.Method) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setRecursive(Boolean) - Method in interface org.apache.beam.examples.complete.AutoComplete.Options

setRpcUri(String) - Method in interface org.apache.beam.examples.complete.datatokenization.options.DataTokenizationOptions

setRpcURI(String) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

setSchema(Schema) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

setSecretStoreUrl(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setSessionGap(Integer) - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

setSourceGCSLocation(String) - Method in class org.apache.beam.examples.subprocess.utils.ExecutableFile

setSourcePath(String) - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

setSourcePath(String) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setStacktrace(String) - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

setStartMin(String) - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

setStopMin(String) - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

setStringValue(ValueProvider<String>) - Method in interface org.apache.beam.examples.snippets.Snippets.MyOptions

setSubProcessConfiguration(SubProcessConfiguration) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setSuccessTag(TupleTag<Row>) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow.Builder

setTeamWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

setThresholdScore(Integer) - Method in interface org.apache.beam.examples.complete.game.StatefulTeamScore.Options

setTopic(String) - Method in interface org.apache.beam.examples.complete.game.LeaderBoard.Options

setTranslateFunction(SerializableFunction<FailsafeElement<T, V>, String>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO.Builder

setTruststorePassword(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setTruststorePath(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setUdfDeadletterTag(TupleTag<FailsafeElement<String, String>>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setUdfOutputTag(TupleTag<FailsafeElement<String, String>>) - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson.Builder

setup() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up external resources that are required by the example, such as Pub/Sub topics and BigQuery tables.

setup() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.TokenizationFn

setUp() - Method in class org.apache.beam.examples.subprocess.ExampleEchoPipeline.EchoInputDoFn

setUp(SubProcessConfiguration, String) - Static method in class org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils

setupBigQueryTable() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up the BigQuery table with the given schema.

setupPubsub() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up the Google Cloud Pub/Sub topic.

setUserActivityWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.game.GameStats.Options

setValue(String) - Method in class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs.Command

setVaultToken(String) - Method in interface org.apache.beam.examples.complete.kafkatopubsub.options.KafkaToPubsubOptions

setWaitTime(Integer) - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

setWaitTime(Integer) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setWikiInput(String) - Method in interface org.apache.beam.examples.complete.TopWikipediaSessions.Options

setWindowDuration(String) - Method in interface org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FileSystemPipelineOptions

setWindowDuration(Duration) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO.Builder

setWindowDuration(Duration) - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder

setWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.game.HourlyTeamScore.Options

setWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

setWindowDuration(Integer) - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

setWindowDuration(Integer) - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

setWindowSize(Integer) - Method in interface org.apache.beam.examples.WindowedWordCount.Options

setWindowSlideEvery(Integer) - Method in interface org.apache.beam.examples.complete.TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions

setWindowSlideEvery(Integer) - Method in interface org.apache.beam.examples.complete.TrafficRoutes.TrafficRoutesOptions

setWorkerPath(String) - Method in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

setWorkerPath(String) - Method in interface org.apache.beam.examples.subprocess.SubProcessPipelineOptions

setWriteDisposition(BigQueryIO.Write.WriteDisposition) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

setWriteMethod(BigQueryIO.Write.Method) - Method in interface org.apache.beam.examples.cookbook.BigQueryTornadoes.Options

sideInputPatterns() - Static method in class org.apache.beam.examples.snippets.Snippets

SklearnMnistClassification - Class in org.apache.beam.examples.multilanguage

An example Java Multi-language pipeline that Performs image classification on handwritten digits from the MNIST database.

SklearnMnistClassification() - Constructor for class org.apache.beam.examples.multilanguage.SklearnMnistClassification

SklearnMnistClassification.SklearnMnistClassificationOptions - Interface in org.apache.beam.examples.multilanguage

Snippets - Class in org.apache.beam.examples.snippets

Code snippets used in webdocs.

Snippets() - Constructor for class org.apache.beam.examples.snippets.Snippets

Snippets.CustomSessionPipeline - Class in org.apache.beam.examples.snippets

Snippets.DeadLetterBigQuery - Class in org.apache.beam.examples.snippets

Snippets.DynamicSessions - Class in org.apache.beam.examples.snippets

Snippets.MyOptions - Interface in org.apache.beam.examples.snippets

Sample of PipelineOptions with a ValueProvider option argument.

Snippets.NaturalLanguageIntegration - Class in org.apache.beam.examples.snippets

Snippets.PeriodicallyUpdatingSideInputs - Class in org.apache.beam.examples.snippets

Snippets.PlaceholderExternalService - Class in org.apache.beam.examples.snippets

Placeholder class that represents an external service generating test data.

Snippets.SchemaJoinPattern - Class in org.apache.beam.examples.snippets

sourcePath - Variable in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

SSL_CREDENTIALS - Static variable in class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

SslConsumerFactoryFn - Class in org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer

Class to create Kafka Consumer with configured SSL.

SslConsumerFactoryFn(Map<String, String>) - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.SslConsumerFactoryFn

StatefulTeamScore - Class in org.apache.beam.examples.complete.game

This class is part of a series of pipelines that tell a story in a gaming domain.

StatefulTeamScore() - Constructor for class org.apache.beam.examples.complete.game.StatefulTeamScore

StatefulTeamScore.Options - Interface in org.apache.beam.examples.complete.game

Options supported by StatefulTeamScore.

StatefulTeamScore.UpdateTeamScoreFn - Class in org.apache.beam.examples.complete.game

Tracks each team's score separately in a single state cell and outputs the score every time it passes a new multiple of a threshold.

StreamingWordExtract - Class in org.apache.beam.examples.complete

A streaming Beam Example using BigQuery output.

StreamingWordExtract() - Constructor for class org.apache.beam.examples.complete.StreamingWordExtract

StreamingWordExtract.StreamingWordExtractOptions - Interface in org.apache.beam.examples.complete

Options supported by StreamingWordExtract.

SubProcessCommandLineArgs - Class in org.apache.beam.examples.subprocess.kernel

Parameters to the sub-process, has tuple of ordinal position and the value.

SubProcessCommandLineArgs() - Constructor for class org.apache.beam.examples.subprocess.kernel.SubProcessCommandLineArgs

SubProcessCommandLineArgs.Command - Class in org.apache.beam.examples.subprocess.kernel

Class used to store the SubProcces parameters.

SubProcessConfiguration - Class in org.apache.beam.examples.subprocess.configuration

Configuration file used to setup the Process kernel for execution of the external library Values are copied from the Options to all them to be Serializable.

SubProcessConfiguration() - Constructor for class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

SubProcessConfigurationFactory() - Constructor for class org.apache.beam.examples.subprocess.SubProcessPipelineOptions.SubProcessConfigurationFactory

SubProcessIOFiles - Class in org.apache.beam.examples.subprocess.kernel

All information generated from the process will be stored in output files.

SubProcessIOFiles(String) - Constructor for class org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

SubProcessKernel - Class in org.apache.beam.examples.subprocess.kernel

This is the process kernel which deals with exec of the subprocess.

SubProcessKernel(SubProcessConfiguration, String) - Constructor for class org.apache.beam.examples.subprocess.kernel.SubProcessKernel

Creates the SubProcess Kernel ready for execution.

SubProcessPipelineOptions - Interface in org.apache.beam.examples.subprocess

Options for running a sub process within a DoFn.

SubProcessPipelineOptions.SubProcessConfigurationFactory - Class in org.apache.beam.examples.subprocess

Confirm Configuration and return a configuration object used in pipeline.

successTag() - Method in class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.RowToTokenizedRow

T

tableName - Variable in class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

TfIdf - Class in org.apache.beam.examples.complete

An example that computes a basic TF-IDF search table for a directory or GCS prefix.

TfIdf() - Constructor for class org.apache.beam.examples.complete.TfIdf

TfIdf.ComputeTfIdf - Class in org.apache.beam.examples.complete

A transform containing a basic TF-IDF pipeline.

TfIdf.Options - Interface in org.apache.beam.examples.complete

Options supported by TfIdf.

TfIdf.ReadDocuments - Class in org.apache.beam.examples.complete

Reads the documents at the provided uris and returns all lines from the documents tagged with which document they are from.

TfIdf.WriteTfIdf - Class in org.apache.beam.examples.complete

A PTransform to write, in CSV format, a mapping from term and URI to score.

TIMESTAMP_ATTRIBUTE - Static variable in class org.apache.beam.examples.complete.game.utils.GameConstants

TokenizationBigQueryIO - Class in org.apache.beam.examples.complete.datatokenization.transforms.io

The TokenizationBigQueryIO class for writing data from template to BigTable.

TokenizationBigQueryIO() - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigQueryIO

TokenizationBigQueryIO.RowToTableRowFn - Class in org.apache.beam.examples.complete.datatokenization.transforms.io

The TokenizationBigQueryIO.RowToTableRowFn class converts a row to tableRow using BigQueryUtils.toTableRow().

TokenizationBigTableIO - Class in org.apache.beam.examples.complete.datatokenization.transforms.io

The TokenizationBigTableIO class for writing data from template to BigTable.

TokenizationBigTableIO(DataTokenizationOptions) - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO

TokenizationBigTableIO.BigTableOptions - Interface in org.apache.beam.examples.complete.datatokenization.transforms.io

Necessary PipelineOptions options for Pipelines that perform write operations to BigTable.

TokenizationFileSystemIO - Class in org.apache.beam.examples.complete.datatokenization.transforms.io

The TokenizationFileSystemIO class to read/write data from/into File Systems.

TokenizationFileSystemIO(DataTokenizationOptions) - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO

TokenizationFileSystemIO.FileSystemPipelineOptions - Interface in org.apache.beam.examples.complete.datatokenization.transforms.io

Necessary PipelineOptions options for Pipelines that operate with JSON/CSV data in FS.

TokenizationFileSystemIO.FORMAT - Enum in org.apache.beam.examples.complete.datatokenization.transforms.io

Supported format to read from GCS.

TokenizationFn(Schema, String, TupleTag<FailsafeElement<Row, Row>>) - Constructor for class org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.TokenizationFn

TOKENIZER_PATTERN - Static variable in class org.apache.beam.examples.common.ExampleUtils

\p{L} denotes the category of Unicode letters, so this pattern will match on everything that is not a letter.

TOKENIZER_PATTERN - Static variable in class org.apache.beam.examples.multilanguage.PythonDataframeWordCount

top(int, boolean) - Static method in class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

TopWikipediaSessions - Class in org.apache.beam.examples.complete

An example that reads Wikipedia edit data from Cloud Storage and computes the user with the longest string of edits separated by no more than an hour within each month.

TopWikipediaSessions() - Constructor for class org.apache.beam.examples.complete.TopWikipediaSessions

TopWikipediaSessions.Options - Interface in org.apache.beam.examples.complete

Options supported by this class.

toString() - Method in class org.apache.beam.examples.complete.datatokenization.utils.FailsafeElement

toStringParams(ProcessBuilder) - Static method in class org.apache.beam.examples.subprocess.utils.FileUtils

TrafficMaxLaneFlow - Class in org.apache.beam.examples.complete

A Beam Example that runs in both batch and streaming modes with traffic sensor data.

TrafficMaxLaneFlow() - Constructor for class org.apache.beam.examples.complete.TrafficMaxLaneFlow

TrafficMaxLaneFlow.MaxFlow - Class in org.apache.beam.examples.complete

A custom 'combine function' used with the Combine.perKey transform.

TrafficMaxLaneFlow.TrafficMaxLaneFlowOptions - Interface in org.apache.beam.examples.complete

Options supported by TrafficMaxLaneFlow.

TrafficRoutes - Class in org.apache.beam.examples.complete

A Beam Example that runs in both batch and streaming modes with traffic sensor data.

TrafficRoutes() - Constructor for class org.apache.beam.examples.complete.TrafficRoutes

TrafficRoutes.TrafficRoutesOptions - Interface in org.apache.beam.examples.complete

Options supported by TrafficRoutes.

translateFunction() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

TriggerExample - Class in org.apache.beam.examples.cookbook

This example illustrates the basic concepts behind triggering.

TriggerExample() - Constructor for class org.apache.beam.examples.cookbook.TriggerExample

TriggerExample.InsertDelays - Class in org.apache.beam.examples.cookbook

Add current time to each record.

TriggerExample.TrafficFlowOptions - Interface in org.apache.beam.examples.cookbook

Inherits standard configuration options.

U

udfDeadletterTag - Variable in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.FailsafeElementToJsonFn

udfDeadletterTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

udfOutputTag() - Method in class org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

unwindowedFilename(int, int, FileBasedSink.OutputFileHints) - Method in class org.apache.beam.examples.common.WriteOneFilePerWindow.PerWindowFiles

unwindowedFilename(int, int, FileBasedSink.OutputFileHints) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText.PerWindowFiles

UpdateTeamScoreFn(int) - Constructor for class org.apache.beam.examples.complete.game.StatefulTeamScore.UpdateTeamScoreFn

USERNAME - Static variable in class org.apache.beam.examples.complete.kafkatopubsub.KafkaPubsubConstants

UserScore - Class in org.apache.beam.examples.complete.game

This class is the first in a series of four pipelines that tell a story in a 'gaming' domain.

UserScore() - Constructor for class org.apache.beam.examples.complete.game.UserScore

UserScore.ExtractAndSumScore - Class in org.apache.beam.examples.complete.game

A transform to extract key/score information from GameActionInfo, and sum the scores.

UserScore.Options - Interface in org.apache.beam.examples.complete.game

Options supported by UserScore.

Utils - Class in org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer

Utilities for construction of Kafka Consumer.

Utils() - Constructor for class org.apache.beam.examples.complete.kafkatopubsub.kafka.consumer.Utils

V

valueOf(String) - Static method in enum org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FORMAT

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform.FORMAT

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO.FORMAT

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.examples.complete.kafkatopubsub.transforms.FormatTransform.FORMAT

Returns an array containing the constants of this enum type, in the order they are declared.

W

waitTime - Variable in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

waitToFinish(PipelineResult) - Method in class org.apache.beam.examples.common.ExampleUtils

Waits for the pipeline to finish and cancels it before the program exists.

WINDOW_DURATION - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

windowCoder() - Method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

windowDuration() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

windowDuration() - Method in class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

windowed - Variable in class org.apache.beam.examples.complete.game.utils.WriteToText

windowedFilename(int, int, BoundedWindow, PaneInfo, FileBasedSink.OutputFileHints) - Method in class org.apache.beam.examples.common.WriteOneFilePerWindow.PerWindowFiles

windowedFilename(int, int, BoundedWindow, PaneInfo, FileBasedSink.OutputFileHints) - Method in class org.apache.beam.examples.complete.game.utils.WriteToText.PerWindowFiles

WindowedWordCount - Class in org.apache.beam.examples

An example that counts words in text, and can run over either unbounded or bounded input collections.

WindowedWordCount() - Constructor for class org.apache.beam.examples.WindowedWordCount

WindowedWordCount.DefaultToCurrentSystemTime - Class in org.apache.beam.examples

A DefaultValueFactory that returns the current system time.

WindowedWordCount.DefaultToMinTimestampPlusOneHour - Class in org.apache.beam.examples

A DefaultValueFactory that returns the minimum timestamp plus one hour.

WindowedWordCount.Options - Interface in org.apache.beam.examples

Options for WindowedWordCount.

withDefaultGapDuration(Duration) - Static method in class org.apache.beam.examples.snippets.Snippets.DynamicSessions

Creates a DynamicSessions WindowFn with the specified gap duration.

WordCount - Class in org.apache.beam.examples

An example that counts words in Shakespeare and includes Beam best practices.

WordCount() - Constructor for class org.apache.beam.examples.WordCount

WordCount.CountWords - Class in org.apache.beam.examples

A PTransform that converts a PCollection containing lines of text into a PCollection of formatted word counts.

WordCount.FormatAsTextFn - Class in org.apache.beam.examples

A SimpleFunction that converts a Word and Count into a printable string.

WordCount.WordCountOptions - Interface in org.apache.beam.examples

Options supported by WordCount.

workerPath - Variable in class org.apache.beam.examples.subprocess.configuration.SubProcessConfiguration

wrapBigQueryInsertError(BigQueryInsertError) - Static method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigQueryIO

Method to wrap a BigQueryInsertError into a FailsafeElement.

write(PCollection<Row>, String, TableSchema) - Static method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigQueryIO

write(PCollection<Row>, Schema) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationBigTableIO

write(PCollection<Row>, Schema) - Method in class org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO

WriteErrorsToTextIO() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteErrorsToTextIO

WriteOneFilePerWindow - Class in org.apache.beam.examples.common

A DoFn that writes elements to files with names deterministically derived from the lower and upper bounds of their key (an IntervalWindow).

WriteOneFilePerWindow(String, Integer) - Constructor for class org.apache.beam.examples.common.WriteOneFilePerWindow

WriteOneFilePerWindow(String) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToText.WriteOneFilePerWindow

WriteOneFilePerWindow.PerWindowFiles - Class in org.apache.beam.examples.common

A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written.

WriteStringMessageErrors() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrors

WriteStringMessageErrorsAsCsv() - Constructor for class org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

WriteTfIdf(String) - Constructor for class org.apache.beam.examples.complete.TfIdf.WriteTfIdf

WriteToBigQuery<InputT> - Class in org.apache.beam.examples.complete.game.utils

Generate, format, and write BigQuery table row information.

WriteToBigQuery() - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

WriteToBigQuery(String, String, String, Map<String, WriteToBigQuery.FieldInfo<InputT>>) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToBigQuery

WriteToBigQuery.BuildRowFn - Class in org.apache.beam.examples.complete.game.utils

Convert each key/score pair into a BigQuery TableRow as specified by fieldFn.

WriteToBigQuery.FieldFn<InputT> - Interface in org.apache.beam.examples.complete.game.utils

A Serializable function from a DoFn.ProcessContext and BoundedWindow to the value for that field.

WriteToBigQuery.FieldInfo<InputT> - Class in org.apache.beam.examples.complete.game.utils

Define a class to hold information about output table field definitions.

WriteToText<InputT> - Class in org.apache.beam.examples.complete.game.utils

Generate, format, and write rows.

WriteToText() - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToText

WriteToText(String, Map<String, WriteToText.FieldFn<InputT>>, boolean) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteToText

WriteToText.BuildRowFn - Class in org.apache.beam.examples.complete.game.utils

Convert each key/score pair into a row as specified by fieldFn.

WriteToText.FieldFn<InputT> - Interface in org.apache.beam.examples.complete.game.utils

A Serializable function from a DoFn.ProcessContext and BoundedWindow to the value for that field.

WriteToText.PerWindowFiles - Class in org.apache.beam.examples.complete.game.utils

A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written.

WriteToText.WriteOneFilePerWindow - Class in org.apache.beam.examples.complete.game.utils

A DoFn that writes elements to files with names deterministically derived from the lower and upper bounds of their key (an IntervalWindow).

WriteWindowedToBigQuery<T> - Class in org.apache.beam.examples.complete.game.utils

Generate, format, and write BigQuery table row information.

WriteWindowedToBigQuery(String, String, String, Map<String, WriteToBigQuery.FieldInfo<T>>) - Constructor for class org.apache.beam.examples.complete.game.utils.WriteWindowedToBigQuery

WriteWindowedToBigQuery.BuildRowFn - Class in org.apache.beam.examples.complete.game.utils

Convert each key/score pair into a BigQuery TableRow.

A B C D E F G H I J K L M N O P R S T U V W