org.apache.beam.examples.complete.datatokenization.transforms.io

Class TokenizationFileSystemIO

java.lang.Object

org.apache.beam.examples.complete.datatokenization.transforms.io.TokenizationFileSystemIO

public class TokenizationFileSystemIO
extends java.lang.Object

The TokenizationFileSystemIO class to read/write data from/into File Systems.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	TokenizationFileSystemIO.FileSystemPipelineOptions Necessary PipelineOptions options for Pipelines that operate with JSON/CSV data in FS.
static class	TokenizationFileSystemIO.FORMAT Supported format to read from GCS.

Constructor Summary

Constructors

Constructor and Description
TokenizationFileSystemIO(DataTokenizationOptions options)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>	read(org.apache.beam.sdk.Pipeline pipeline, SchemasUtils schema)
org.apache.beam.sdk.values.PDone	write(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input, org.apache.beam.sdk.schemas.Schema schema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizationFileSystemIO

public TokenizationFileSystemIO(DataTokenizationOptions options)

Method Detail

read

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> read(org.apache.beam.sdk.Pipeline pipeline,
                                                                                   SchemasUtils schema)

write

public org.apache.beam.sdk.values.PDone write(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input,
                                              org.apache.beam.sdk.schemas.Schema schema)