Package org.apache.beam.examples.complete.datatokenization.utils

Class CsvConverters.LineToFailsafeJson

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    Enclosing class:
    CsvConverters
    public abstract static class CsvConverters.LineToFailsafeJson
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionTuple,​org.apache.beam.sdk.values.PCollectionTuple>
    The CsvConverters.LineToFailsafeJson interface converts a line from a Csv file into a Json string. Uses either: Javascript Udf, Json schema or the headers of the file to create the Json object which is then added to the FailsafeElement as the new payload.
    See Also:
    Serialized Form

    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        annotations, displayData, name, resourceHints

    • Method Summary

      All Methods Static Methods Instance Methods Abstract Methods Concrete Methods 
      Modifier and Type Method Description
      abstract java.lang.String delimiter()  
      org.apache.beam.sdk.values.PCollectionTuple expand​(org.apache.beam.sdk.values.PCollectionTuple lines)  
      abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> headerTag()  
      abstract java.lang.String jsonSchema()  
      abstract java.lang.String jsonSchemaPath()  
      abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> lineTag()  
      static CsvConverters.LineToFailsafeJson.Builder newBuilder()  
      abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,​java.lang.String>> udfDeadletterTag()  
      abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,​java.lang.String>> udfOutputTag()  

      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Constructor Detail

      • LineToFailsafeJson

        public LineToFailsafeJson()

    • Method Detail

      • delimiter

        public abstract java.lang.String delimiter()

      • jsonSchemaPath

        @Nullable
public abstract java.lang.String jsonSchemaPath()

      • jsonSchema

        @Nullable
public abstract java.lang.String jsonSchema()

      • headerTag

        public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> headerTag()

      • lineTag

        public abstract org.apache.beam.sdk.values.TupleTag<java.lang.String> lineTag()

      • udfOutputTag

        public abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,​java.lang.String>> udfOutputTag()

      • udfDeadletterTag

        public abstract org.apache.beam.sdk.values.TupleTag<FailsafeElement<java.lang.String,​java.lang.String>> udfDeadletterTag()

      • expand

        public org.apache.beam.sdk.values.PCollectionTuple expand​(org.apache.beam.sdk.values.PCollectionTuple lines)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionTuple,​org.apache.beam.sdk.values.PCollectionTuple>