org.apache.beam.examples.complete.datatokenization.utils

Class ErrorConverters.WriteStringMessageErrorsAsCsv

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<FailsafeElement<java.lang.String,java.lang.String>>,org.apache.beam.sdk.values.PDone>

org.apache.beam.examples.complete.datatokenization.utils.ErrorConverters.WriteStringMessageErrorsAsCsv

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

ErrorConverters

public abstract static class ErrorConverters.WriteStringMessageErrorsAsCsv
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<FailsafeElement<java.lang.String,java.lang.String>>,org.apache.beam.sdk.values.PDone>

Writes all Errors to GCS, place at the end of your pipeline.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ErrorConverters.WriteStringMessageErrorsAsCsv.Builder Builder for ErrorConverters.WriteStringMessageErrorsAsCsv.

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
WriteStringMessageErrorsAsCsv()

Method Summary

Modifier and Type	Method and Description
abstract java.lang.String	csvDelimiter()
abstract java.lang.String	errorWritePath()
org.apache.beam.sdk.values.PDone	expand(org.apache.beam.sdk.values.PCollection<FailsafeElement<java.lang.String,java.lang.String>> pCollection)
static ErrorConverters.WriteStringMessageErrorsAsCsv.Builder	newBuilder()
abstract @Nullable org.joda.time.Duration	windowDuration()

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

WriteStringMessageErrorsAsCsv

public WriteStringMessageErrorsAsCsv()

Method Detail

newBuilder

public static ErrorConverters.WriteStringMessageErrorsAsCsv.Builder newBuilder()

errorWritePath

public abstract java.lang.String errorWritePath()

csvDelimiter

public abstract java.lang.String csvDelimiter()

windowDuration

public abstract @Nullable org.joda.time.Duration windowDuration()

expand

public org.apache.beam.sdk.values.PDone expand(org.apache.beam.sdk.values.PCollection<FailsafeElement<java.lang.String,java.lang.String>> pCollection)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<FailsafeElement<java.lang.String,java.lang.String>>,org.apache.beam.sdk.values.PDone>