org.apache.beam.examples.complete.datatokenization.utils

Class CsvConverters

java.lang.Object

org.apache.beam.examples.complete.datatokenization.utils.CsvConverters

public class CsvConverters
extends java.lang.Object

Common transforms for Csv files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	CsvConverters.CsvPipelineOptions Necessary PipelineOptions options for Csv Pipelines.
static class	CsvConverters.DelimiterFactory Default value factory to get delimiter from Csv format so that if the user does not pass one in, it matches the supplied CsvConverters.CsvPipelineOptions.getCsvFormat().
static class	CsvConverters.FailsafeElementToJsonFn The CsvConverters.FailsafeElementToJsonFn class creates a Json string from a failsafe element.
static class	CsvConverters.LineToFailsafeJson The CsvConverters.LineToFailsafeJson interface converts a line from a Csv file into a Json string.
static class	CsvConverters.ReadCsv The CsvConverters.ReadCsv class is a PTransform that reads from one for more Csv files.

Constructor Summary

Constructors

Constructor and Description
CsvConverters()

Method Summary

Modifier and Type	Method and Description
static org.apache.commons.csv.CSVFormat	getCsvFormat(java.lang.String formatString, java.lang.String delimiter) Gets Csv format accoring to Apache Commons CSV.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CsvConverters

public CsvConverters()

Method Detail

getCsvFormat

public static org.apache.commons.csv.CSVFormat getCsvFormat(java.lang.String formatString,
                                                            @Nullable
                                                            java.lang.String delimiter)

Gets Csv format accoring to Apache Commons CSV. If user passed invalid format error is thrown.