Package org.apache.beam.examples.complete.datatokenization.utils
Protegrity Data Tokenization template for Google Cloud Teleport.
-
Interface Summary Interface Description CsvConverters.CsvPipelineOptions NecessaryPipelineOptionsoptions for Csv Pipelines. -
Class Summary Class Description CsvConverters Common transforms for Csv files.CsvConverters.DelimiterFactory Default value factory to get delimiter from Csv format so that if the user does not pass one in, it matches the suppliedCsvConverters.CsvPipelineOptions.getCsvFormat().CsvConverters.FailsafeElementToJsonFn TheCsvConverters.FailsafeElementToJsonFnclass creates a Json string from a failsafe element.CsvConverters.LineToFailsafeJson TheCsvConverters.LineToFailsafeJsoninterface converts a line from a Csv file into a Json string.CsvConverters.LineToFailsafeJson.Builder Builder forCsvConverters.LineToFailsafeJson.CsvConverters.ReadCsv TheCsvConverters.ReadCsvclass is aPTransformthat reads from one for more Csv files.CsvConverters.ReadCsv.Builder Builder forCsvConverters.ReadCsv.DurationUtils TheDurationUtilsclass provides common utilities for manipulating and formattingDurationobjects.ErrorConverters Transforms & DoFns & Options for Teleport Error logging.ErrorConverters.FailedStringToCsvRowFn TheErrorConverters.FailedStringToCsvRowFnconverts string objects which have failed processing intoStringobjects contained CSV which can be output to a filesystem.ErrorConverters.FailedStringToTableRowFn TheErrorConverters.FailedStringToTableRowFnconverts string objects which have failed processing intoTableRowobjects which can be output to a dead-letter table.ErrorConverters.WriteErrorsToTextIO<T,V> ErrorConverters.WriteErrorsToTextIOis aPTransformthat writes strings error messages to file system using TextIO and custom line formatSerializableFunctionto convert errors in necessary format.ErrorConverters.WriteErrorsToTextIO.Builder<T,V> Builder forErrorConverters.WriteErrorsToTextIO.ErrorConverters.WriteStringMessageErrors Write errors as string encoded messages.ErrorConverters.WriteStringMessageErrors.Builder Builder forErrorConverters.WriteStringMessageErrors.ErrorConverters.WriteStringMessageErrorsAsCsv Writes all Errors to GCS, place at the end of your pipeline.ErrorConverters.WriteStringMessageErrorsAsCsv.Builder Builder forErrorConverters.WriteStringMessageErrorsAsCsv.FailsafeElement<OriginalT,CurrentT> TheFailsafeElementclass holds the current value and original value of a record within a pipeline.FailsafeElementCoder<OriginalT,CurrentT> TheFailsafeElementCoderencodes and decodesFailsafeElementobjects.RowToCsv TheRowToCsvclass to convert Beam Rows into strings in CSV format.SchemasUtils TheSchemasUtilsClass to read JSON based schema.