Package io.deltastream.flink.connector.snowflake.sink.internal

Class SnowflakeSinkServiceImpl

java.lang.Object

io.deltastream.flink.connector.snowflake.sink.internal.SnowflakeSinkServiceImpl

All Implemented Interfaces:

SnowflakeSinkService, AutoCloseable

@Internal
public class SnowflakeSinkServiceImpl
extends Object
implements SnowflakeSinkService

This class is the service implementation for managing ingest client and channel for writing Snowflake rows to a db.schema.table in the external service.

Constructor Summary

Constructors

Constructor	Description
SnowflakeSinkServiceImpl(String appId, int taskId, Properties connectionConfig, SnowflakeWriterConfig writerConfig, SnowflakeChannelConfig channelConfig, org.apache.flink.metrics.groups.SinkWriterMetricGroup metricGroup)	Construct a new sink service to provide APIs to the Snowflake service.

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush()	Flush internal data, if applicable.
net.snowflake.ingest.streaming.SnowflakeStreamingIngestChannel	getChannel()
SnowflakeChannelConfig	getChannelConfig()
String	getChannelName()
net.snowflake.ingest.streaming.SnowflakeStreamingIngestClient	getClient()
protected long	getLatestCommittedOffsetFromSnowflakeIngestChannel()
SnowflakeWriterConfig	getWriterConfig()
void	insert(Map<String,Object> row)	Insert a Map serialized record to be written.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SnowflakeSinkServiceImpl

public SnowflakeSinkServiceImpl(String appId,
 int taskId,
 Properties connectionConfig,
 SnowflakeWriterConfig writerConfig,
 SnowflakeChannelConfig channelConfig,
 org.apache.flink.metrics.groups.SinkWriterMetricGroup metricGroup)

Construct a new sink service to provide APIs to the Snowflake service.

Parameters:

appId - String UID for Flink job

taskId - Integer Flink subtask ID

connectionConfig - Properties Snowflake connection settings

writerConfig - SnowflakeWriterConfig

channelConfig - SnowflakeChannelConfig

metricGroup - SinkWriterMetricGroup

Method Details

getWriterConfig

public SnowflakeWriterConfig getWriterConfig()

getChannelConfig

public SnowflakeChannelConfig getChannelConfig()

getClient

public net.snowflake.ingest.streaming.SnowflakeStreamingIngestClient getClient()

getChannelName

public String getChannelName()

getChannel

public net.snowflake.ingest.streaming.SnowflakeStreamingIngestChannel getChannel()

insert

public void insert(Map<String,Object> row)
            throws IOException

Description copied from interface: SnowflakeSinkService

Insert a Map serialized record to be written.

Specified by:

insert in interface SnowflakeSinkService

Parameters:

row - Map serialized Snowflake row to insert

Throws:

IOException

flush

public void flush()
           throws IOException

Description copied from interface: SnowflakeSinkService

Flush internal data, if applicable.

Specified by:

flush in interface SnowflakeSinkService

Throws:

IOException - if data flush failed to write to backend

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception

getLatestCommittedOffsetFromSnowflakeIngestChannel

protected long getLatestCommittedOffsetFromSnowflakeIngestChannel()