Package com.snowflake.kafka.connector.internal

Class SnowflakeIngestionServiceV1

java.lang.Object

com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1

All Implemented Interfaces:

SnowflakeIngestionService

public class SnowflakeIngestionServiceV1
extends Object
implements SnowflakeIngestionService

Implementation of Snowpipe API calls. i.e handshake between KC and Snowpipe API's.

1. ingestFiles

2. insertReport - Continuous polling

3. loadHistoryScan - for last 1 hour.

The difference between above two APIs @see here

Method Summary

Modifier and Type	Method	Description
void	close()	close ingest service
net.snowflake.ingest.SimpleIngestManager	getIngestManager()
String	getStageName()
void	ingestFile(String fileName)	Ingest single file
void	ingestFiles(List<String> fileNames)	Ingest a list of files
Map<String,com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus>	readIngestReport(List<String> files)	retrieve status of given files from the ingest report
Map<String,com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus>	readOneHourHistory(List<String> files, long startTime)	retrieve status of given files from load history in one hour time window
void	setTelemetry(SnowflakeTelemetryService telemetry)	Set telemetry client

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

setTelemetry

public void setTelemetry(SnowflakeTelemetryService telemetry)

Description copied from interface: SnowflakeIngestionService

Set telemetry client

Specified by:

setTelemetry in interface SnowflakeIngestionService

Parameters:

telemetry - telemetry client

ingestFile

public void ingestFile(String fileName)

Description copied from interface: SnowflakeIngestionService

Ingest single file

Specified by:

ingestFile in interface SnowflakeIngestionService

Parameters:

fileName - file name

ingestFiles

public void ingestFiles(List<String> fileNames)

Description copied from interface: SnowflakeIngestionService

Ingest a list of files

Specified by:

ingestFiles in interface SnowflakeIngestionService

Parameters:

fileNames - file name List

getStageName

public String getStageName()

Specified by:

getStageName in interface SnowflakeIngestionService

Returns:

corresponding stage name

readIngestReport

public Map<String,com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus> readIngestReport(List<String> files)

Description copied from interface: SnowflakeIngestionService

retrieve status of given files from the ingest report

Specified by:

readIngestReport in interface SnowflakeIngestionService

Parameters:

files - a list of file name

Returns:

a map contains all file status

readOneHourHistory

public Map<String,com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus> readOneHourHistory(List<String> files,
                                                                                                                    long startTime)

Description copied from interface: SnowflakeIngestionService

retrieve status of given files from load history in one hour time window

Specified by:

readOneHourHistory in interface SnowflakeIngestionService

Parameters:

files - a list of file name

startTime - the start time stamp of time window in ms

Returns:

a map contains all file status

close

public void close()

Description copied from interface: SnowflakeIngestionService

close ingest service

Specified by:

close in interface SnowflakeIngestionService

getIngestManager

public net.snowflake.ingest.SimpleIngestManager getIngestManager()