org.apache.beam.examples.complete.datatokenization.utils

Class SchemasUtils

java.lang.Object

org.apache.beam.examples.complete.datatokenization.utils.SchemasUtils

public class SchemasUtils
extends java.lang.Object

The SchemasUtils Class to read JSON based schema. Is there available to read from file or from string. Currently supported local File System and GCS.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEADLETTER_SCHEMA

Constructor Summary

Constructors

Constructor and Description
SchemasUtils(java.lang.String schema)
SchemasUtils(java.lang.String path, java.nio.charset.Charset encoding)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.schemas.Schema	getBeamSchema()
com.google.api.services.bigquery.model.TableSchema	getBigQuerySchema()
static java.lang.String	getGcsFileAsString(java.lang.String filePath) Reads a file from GCS and returns it as a string.
java.lang.String	getJsonBeamSchema()
static byte[]	readGcsFile(java.lang.String gcsFilePath) Method to read a schema file from GCS and return the file contents as a string.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEADLETTER_SCHEMA

public static final java.lang.String DEADLETTER_SCHEMA

See Also:

Constant Field Values

Constructor Detail

SchemasUtils

public SchemasUtils(java.lang.String schema)

SchemasUtils

public SchemasUtils(java.lang.String path,
                    java.nio.charset.Charset encoding)
             throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getBigQuerySchema

public com.google.api.services.bigquery.model.TableSchema getBigQuerySchema()

readGcsFile

public static byte[] readGcsFile(java.lang.String gcsFilePath)
                          throws java.io.IOException

Method to read a schema file from GCS and return the file contents as a string.

Parameters:

gcsFilePath - path to file in GCS in format "gs://your-bucket/path/to/file"

Returns:

byte array with file contents

Throws:

java.io.IOException - thrown if not able to read file

getBeamSchema

public org.apache.beam.sdk.schemas.Schema getBeamSchema()

getJsonBeamSchema

public java.lang.String getJsonBeamSchema()

getGcsFileAsString

public static java.lang.String getGcsFileAsString(java.lang.String filePath)

Reads a file from GCS and returns it as a string.

Parameters:

filePath - path to file in GCS

Returns:

contents of the file as a string

Throws:

java.io.IOException - thrown if not able to read file