org.apache.beam.sdk.extensions.sql.meta.provider.kafka

Class BeamKafkaCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamKafkaCSVTable
extends BeamKafkaTable

A Kafka topic that saves records as CSV format.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BeamKafkaCSVTable.CsvRecorderDecoder A PTransform to convert KV<byte[], byte[]> to Row.
static class	BeamKafkaCSVTable.CsvRecorderEncoder A PTransform to convert Row to KV<byte[], byte[]>.

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamKafkaCSVTable(org.apache.beam.sdk.schemas.Schema beamSchema, java.lang.String bootstrapServers, java.util.List<java.lang.String> topics)
BeamKafkaCSVTable(org.apache.beam.sdk.schemas.Schema beamSchema, java.lang.String bootstrapServers, java.util.List<java.lang.String> topics, org.apache.commons.csv.CSVFormat format)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<byte[],byte[]>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>>	getPTransformForInput()
org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<byte[],byte[]>>>	getPTransformForOutput()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

buildIOReader, buildIOWriter, getBootstrapServers, getTopics, isBounded, updateConsumerProperties

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamKafkaCSVTable

public BeamKafkaCSVTable(org.apache.beam.sdk.schemas.Schema beamSchema,
                         java.lang.String bootstrapServers,
                         java.util.List<java.lang.String> topics)

BeamKafkaCSVTable

public BeamKafkaCSVTable(org.apache.beam.sdk.schemas.Schema beamSchema,
                         java.lang.String bootstrapServers,
                         java.util.List<java.lang.String> topics,
                         org.apache.commons.csv.CSVFormat format)

Method Detail

getPTransformForInput

public org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<byte[],byte[]>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>> getPTransformForInput()

Specified by:

getPTransformForInput in class BeamKafkaTable

getPTransformForOutput

public org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<byte[],byte[]>>> getPTransformForOutput()

Specified by:

getPTransformForOutput in class BeamKafkaTable