org.apache.beam.examples.complete.datatokenization.utils

Class CsvConverters.ReadCsv

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollectionTuple>

org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.ReadCsv

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

CsvConverters

public abstract static class CsvConverters.ReadCsv
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollectionTuple>

The CsvConverters.ReadCsv class is a PTransform that reads from one for more Csv files. The transform returns a PCollectionTuple consisting of the following PCollection:

• headerTag() - Contains headers found in files if read with headers, contains empty PCollection if no headers.
• lineTag() - Contains Csv lines as a PCollection of strings.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CsvConverters.ReadCsv.Builder Builder for CsvConverters.ReadCsv.

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
ReadCsv()

Method Summary

Modifier and Type	Method and Description
abstract java.lang.String	csvFormat()
abstract java.lang.String	delimiter()
org.apache.beam.sdk.values.PCollectionTuple	expand(org.apache.beam.sdk.values.PBegin input)
abstract java.lang.Boolean	hasHeaders()
abstract org.apache.beam.sdk.values.TupleTag<java.lang.String>	headerTag()
abstract java.lang.String	inputFileSpec()
abstract org.apache.beam.sdk.values.TupleTag<java.lang.String>	lineTag()
static CsvConverters.ReadCsv.Builder	newBuilder()

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ReadCsv

public ReadCsv()

Method Detail

newBuilder

public static CsvConverters.ReadCsv.Builder newBuilder()

csvFormat

public abstract java.lang.String csvFormat()

delimiter

@Nullable
public abstract java.lang.String delimiter()

hasHeaders

public abstract java.lang.Boolean hasHeaders()

inputFileSpec

public abstract java.lang.String inputFileSpec()

headerTag

public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> headerTag()

lineTag

public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> lineTag()

expand

public org.apache.beam.sdk.values.PCollectionTuple expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollectionTuple>