org.apache.beam.examples.complete.datatokenization.utils

Class CsvConverters.LineToFailsafeJson

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionTuple,org.apache.beam.sdk.values.PCollectionTuple>

org.apache.beam.examples.complete.datatokenization.utils.CsvConverters.LineToFailsafeJson

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

CsvConverters

public abstract static class CsvConverters.LineToFailsafeJson
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionTuple,org.apache.beam.sdk.values.PCollectionTuple>

The CsvConverters.LineToFailsafeJson interface converts a line from a Csv file into a Json string. Uses either: Javascript Udf, Json schema or the headers of the file to create the Json object which is then added to the FailsafeElement as the new payload.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CsvConverters.LineToFailsafeJson.Builder Builder for CsvConverters.LineToFailsafeJson.

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
LineToFailsafeJson()

Method Summary

Modifier and Type	Method and Description
abstract java.lang.String	delimiter()
org.apache.beam.sdk.values.PCollectionTuple	expand(org.apache.beam.sdk.values.PCollectionTuple lines)
abstract org.apache.beam.sdk.values.TupleTag<java.lang.String>	headerTag()
abstract java.lang.String	jsonSchema()
abstract java.lang.String	jsonSchemaPath()
abstract org.apache.beam.sdk.values.TupleTag<java.lang.String>	lineTag()
static CsvConverters.LineToFailsafeJson.Builder	newBuilder()
abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,java.lang.String>>	udfDeadletterTag()
abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,java.lang.String>>	udfOutputTag()

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

LineToFailsafeJson

public LineToFailsafeJson()

Method Detail

newBuilder

public static CsvConverters.LineToFailsafeJson.Builder newBuilder()

delimiter

public abstract java.lang.String delimiter()

jsonSchemaPath

@Nullable
public abstract java.lang.String jsonSchemaPath()

jsonSchema

@Nullable
public abstract java.lang.String jsonSchema()

headerTag

public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> headerTag()

lineTag

public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> lineTag()

udfOutputTag

public abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,java.lang.String>> udfOutputTag()

udfDeadletterTag

public abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,java.lang.String>> udfDeadletterTag()

expand

public org.apache.beam.sdk.values.PCollectionTuple expand(org.apache.beam.sdk.values.PCollectionTuple lines)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionTuple,org.apache.beam.sdk.values.PCollectionTuple>