A B C D E F G H I J K L M N O P Q R S T U V W 
All Classes All Packages

A

ACCESS_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
addAndGetFileCountOnIngestion(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addAndGetFileCountOnStage(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addAndGetFileCountPurged(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addAndGetMemoryUsage(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addAndGetTotalNumberOfRecord(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addAndGetTotalSizeOfData(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
addTask(String, TopicPartition) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
Add task for table and TopicPartition.
addUserConnectorPropertiesToDataNode(Map<String, String>, ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
Adds specific user provided connector properties to ObjectNode
ALL - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
Tolerate all errors.
allIngestionTypes() - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
 
alterNonNullableColumns(String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Alter table to drop non-nullability of a list of columns
alterNonNullableColumns(String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
Alter table to drop non-nullability of a list of columns
appendColumnsToTable(String, Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Alter table to add columns according to a map from columnNames to their types
appendColumnsToTable(String, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
Alter table to add columns according to a map from columnNames to their types
appendMetaColIfNotExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Append a VARIANT type column "RECORD_METADATA" to the table if it is not present.
appendMetaColIfNotExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
apply() - Method in interface com.snowflake.kafka.connector.internal.InternalUtils.backoffFunction
 
AVERAGE_COMMIT_LAG_FILE_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
AVERAGE_COMMIT_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
AVERAGE_INGESTION_LAG_FILE_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
AVERAGE_INGESTION_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
AVERAGE_KAFKA_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
AVERAGE_KAFKA_LAG_RECORD_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 

B

backoffAndRetry(SnowflakeTelemetryService, SnowflakeInternalOperations, InternalUtils.backoffFunction) - Static method in class com.snowflake.kafka.connector.internal.InternalUtils
Backoff logic
backoffSec - Static variable in class com.snowflake.kafka.connector.internal.InternalUtils
 
BASIC_AUTH_HEADER_PREFIX - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
BEHAVIOR_ON_NULL_VALUES_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BOOLEAN_VALIDATOR - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
Boolean Validator of passed booleans in configurations (TRUE or FALSE).
BREAK_ON_SCHEMA_REGISTRY_ERROR - Static variable in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
 
BUFFER_COUNT_RECORDS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_COUNT_RECORDS_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_COUNT_RECORDS_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_FLUSH_TIME_SEC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_FLUSH_TIME_SEC_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_FLUSH_TIME_SEC_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_RECORD_COUNT - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
BUFFER_SIZE_BYTES - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
BUFFER_SIZE_BYTES - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_SIZE_BYTES_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_SIZE_BYTES_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
BUFFER_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
BufferThreshold - Class in com.snowflake.kafka.connector.internal
Helper class associated to runtime of Kafka Connect which can help to identify if there is a need to flush the buffered records.
BufferThreshold(IngestionMethodConfig, long, long, long) - Constructor for class com.snowflake.kafka.connector.internal.BufferThreshold
Public constructor
build() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
build() - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
build() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
 
builder() - Static method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory
 
builder(SnowflakeConnectionService) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
Basic builder which internally uses SinkServiceV1 (Snowpipe)
builder(SnowflakeConnectionService, IngestionMethodConfig, Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
create service builder.
builder(String, String, String, int, String, String, String, PrivateKey, String) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceFactory
 
builder(Connection, IngestionMethodConfig) - Static method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory
 
buildIngestService(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
build ingest service instance for given stage and pipe
buildIngestService(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
buildOAuthHttpPostRequest(SnowflakeURL, String, Map<String, String>, StringEntity) - Static method in class com.snowflake.kafka.connector.Utils
Build OAuth http post request base on headers and payload
BYTE_NUMBER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 

C

callAllGetOffset() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
used for testing only
callAllGetOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
CHANNEL_OFFSET_TOKEN_MIGRATION_GENERAL_EXCEPTION - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
ChannelMigrateOffsetTokenResponseDTO - Class in com.snowflake.kafka.connector.internal.streaming
POJO used to serialize the System function response for migration offset from Source Channel to Destination.
ChannelMigrateOffsetTokenResponseDTO() - Constructor for class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
Default Ctor for Jackson
ChannelMigrateOffsetTokenResponseDTO(long, String) - Constructor for class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
 
ChannelMigrationResponseCode - Enum in com.snowflake.kafka.connector.internal.streaming
Response code sent from the system function to migrate offsets from Source to Destination Channel.
checkErrorCode(SnowflakeErrors) - Method in exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
 
CLEANER_RESTART_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
close() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Close Connection
close() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
close() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
close ingest service
close() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
close(Collection<TopicPartition>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
terminate given topic partitions
close(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
This function is called during rebalance.
close(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
Closes sink service
closeAll() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
terminate all tasks and close this service instance
closeAll() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
closeChannel() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Close channel associated to this partition Not rethrowing connect exception because the connector will stop.
closeClient(SnowflakeStreamingIngestClient) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
Closes the given client.
closeClient(SnowflakeStreamingIngestClient) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
Closes the given client
com.snowflake.kafka.connector - package com.snowflake.kafka.connector
 
com.snowflake.kafka.connector.dlq - package com.snowflake.kafka.connector.dlq
 
com.snowflake.kafka.connector.internal - package com.snowflake.kafka.connector.internal
 
com.snowflake.kafka.connector.internal.metrics - package com.snowflake.kafka.connector.internal.metrics
 
com.snowflake.kafka.connector.internal.streaming - package com.snowflake.kafka.connector.internal.streaming
 
com.snowflake.kafka.connector.internal.streaming.telemetry - package com.snowflake.kafka.connector.internal.streaming.telemetry
 
com.snowflake.kafka.connector.internal.telemetry - package com.snowflake.kafka.connector.internal.telemetry
 
com.snowflake.kafka.connector.records - package com.snowflake.kafka.connector.records
 
COMMIT_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
Time difference between file being uploaded to internal stage to time invoking insertFiles API.
COMMITTED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Offset number (Record) for which precommit SinkTask.preCommit(Map) API was called and we called snowpipe's insertFiles API.
COMMITTED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
config() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
 
configure(Map<String, ?>, boolean) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
 
configure(Map<String, ?>, boolean) - Method in class com.snowflake.kafka.connector.records.SnowflakeConverter
unused
CONFLUENT - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
 
CONNECTOR_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
constructMetricName(String, String, String) - Static method in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Construct the actual metrics name that will be passed in by dropwizard framework to MetricsJmxReporter.getObjectName(String, String, String) We will prefix actual metric name with partitionName and subcategory of the metric.
convertAppName(Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
modify invalid application name in config and return the generated application name
convertConfigForStreamingClient(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
convertToJson(Schema, Object) - Static method in class com.snowflake.kafka.connector.records.RecordService
Convert this object, in the org.apache.kafka.connect.data format, into a JSON object, returning the converted object.
createClient(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
Creates a streaming client from the given config
createPipe(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
create a snowpipe if not exists
createPipe(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createPipe(String, String, String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
create a snowpipe
createPipe(String, String, String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createStage(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
create stage if not exists
createStage(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createStage(String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
create a stage
createStage(String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createTable(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
create table is not exists
createTable(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createTable(String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Create a table with two variant columns: RECORD_METADATA and RECORD_CONTENT
createTable(String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
createTableWithOnlyMetadataColumn(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Create a table with only the RECORD_METADATA column.
createTableWithOnlyMetadataColumn(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
CUSTOM_SNOWFLAKE_CONVERTERS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 

D

databaseExists(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check if a given database exists
databaseExists(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
debug(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
Logs an debug level message
DEFAULT - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
 
DEFAULT_REDIRECT_URI - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
defaultValue() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
determineIngestionMethod(Map<String, String>) - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
Returns the Ingestion Method found in User Configuration for Snowflake Kafka Connector.
doc() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
dropPipe(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
drop snowpipe
dropPipe(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
dropStage(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
drop stage
dropStage(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
dropStageIfEmpty(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
drop stage if the given stage is empty
dropStageIfEmpty(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
dummyPutCommandTemplateAWSAndAzure - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
 
dummyPutCommandTemplateGCS - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
 
dummyPutCommandToGetStageType - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
 
dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
 
dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 
dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
Adds the required fields into the given ObjectNode which will then be used as payload in Telemetry API
dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
DURATION_BETWEEN_GET_OFFSET_TOKEN_RETRY - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 

E

ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_MDC_LOGGING_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_MDC_LOGGING_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_MDC_LOGGING_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_MDC_LOGGING_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_SCHEMATIZATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_SCHEMATIZATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_STREAMING_CLIENT_OPTIMIZATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_STREAMING_CLIENT_OPTIMIZATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_STREAMING_CLIENT_OPTIMIZATION_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ENABLE_STREAMING_CLIENT_OPTIMIZATION_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
EncryptionUtils - Class in com.snowflake.kafka.connector.internal
 
EncryptionUtils() - Constructor for class com.snowflake.kafka.connector.internal.EncryptionUtils
 
END_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
ensureValid(String, Object) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
 
ensureValid(String, Object) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
 
ERR_TABLE_DOES_NOT_EXIST_NOT_AUTHORIZED - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
error(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
Logs an error level message
ERROR_0001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0018 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0019 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0020 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0021 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0022 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0023 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0024 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0025 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0026 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0027 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0028 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_0029 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_1001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_1002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_1003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_1004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_2017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_3001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_3002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_3003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_3004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_3005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_4001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5018 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5019 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5020 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5021 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5022 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_5023 - com.snowflake.kafka.connector.internal.SnowflakeErrors
 
ERROR_GROUP - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_LOG_ENABLE_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_LOG_ENABLE_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_LOG_ENABLE_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_LOG_ENABLE_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_TOLERANCE_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_TOLERANCE_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_TOLERANCE_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
ERRORS_TOLERANCE_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
evolveSchemaIfNeeded(SnowflakeConnectionService, String, List<String>, List<String>, SinkRecord) - Static method in class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
Execute a ALTER TABLE command if there is any extra column that needs to be added, or any column nullability that needs to be updated, used by schema evolution

F

FETCH_OAUTH_TOKEN - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
fetchOffsetTokenWithRetry() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Fetches the offset token from Snowflake.
field(String) - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
fields() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
FILE_COUNT_ON_INGESTION - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Number of files we call insertFiles API in snowpipe.
FILE_COUNT_ON_INGESTION - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_ON_STAGE - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Number of files currently on an internal stage.
FILE_COUNT_ON_STAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_PURGED - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Number of files purged from internal stage because we were able to verify the ingestion status
FILE_COUNT_PURGED - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_REPROCESS_PURGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_RESTART - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
FILE_COUNT_TABLE_STAGE_BROKEN_RECORD - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Number of files present on table stage because files corresponds to broken offset (Broken record)
FILE_COUNT_TABLE_STAGE_BROKEN_RECORD - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_TABLE_STAGE_INGEST_FAIL - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
FILE_COUNT_TABLE_STAGE_INGESTION_FAIL - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Number of files present on table stage due to failed ingestion (Missing Ingestion Status).
fileName(String, String, int, long, long) - Static method in class com.snowflake.kafka.connector.internal.FileNameUtils
generate file name File Name Format: app/table/partition/start_end_timeStamp.fileFormat.gz Note: all file names should using the this format
FileNameUtils - Class in com.snowflake.kafka.connector.internal
 
FileNameUtils() - Constructor for class com.snowflake.kafka.connector.internal.FileNameUtils
 
FLUSHED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Offset number(Record) that is being flushed into an internal stage after the buffer threshold was reached.
FLUSHED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
formatLogMessage(String, Object...) - Static method in class com.snowflake.kafka.connector.Utils
the following method wraps log messages with Snowflake tag.
formatName(String) - Static method in class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
Transform the objectName to uppercase unless it is enclosed in double quotes
formatString(String, Object...) - Static method in class com.snowflake.kafka.connector.Utils
 
fromConnectData(String, Schema, Object) - Method in class com.snowflake.kafka.connector.records.SnowflakeConverter
doesn't support data source connector

G

generateChannelNameFormatV2(String, String) - Static method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
This is the new channel Name format that was created.
generateProxyParametersIfRequired(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.InternalUtils
Helper method to decide whether to add any properties related to proxy server.
generateValidName(String, Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
verify topic name, and generate valid table/application name
GET_EXCEPTION_FORMAT - Static variable in class com.snowflake.kafka.connector.Utils
 
GET_EXCEPTION_MISSING_CAUSE - Static variable in class com.snowflake.kafka.connector.Utils
 
GET_EXCEPTION_MISSING_MESSAGE - Static variable in class com.snowflake.kafka.connector.Utils
 
getApproxSizeOfRecordInBytes(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Get Approximate size of Sink Record which we get from Kafka.
getBehaviorOnNullValuesConfig() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
getBehaviorOnNullValuesConfig() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getBrokenData() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
 
getBufferSizeBytes() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
getChannel() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getChannelMigrateOffsetTokenResponseDTO(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
getChannelNameFormatV1() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getClient(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
Gets the current client or creates a new one from the given connector config.
getCode() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getCode() - Method in exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
 
getConnection() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
 
getConnection() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
getConnectorName() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
 
getConnectorName() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
getData() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
Return the data that was buffered because buffer threshold might have been reached
getData() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
Get all rows and their offsets.
getData() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
 
getDefaultObjectNode(IngestionMethodConfig) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
This is the minimum JsonNode which will be present in each telemetry Payload.
getDetail() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getDlqTopicName(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
getException() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getException(SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getException(Exception) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getException(Exception, SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getException(String) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
getException(String, SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
Convert a given message into SnowflakeKafkaConnectorException.
getExceptionMessage(String, Exception) - Static method in class com.snowflake.kafka.connector.Utils
Get the message and cause of a missing exception, handling the null or empty cases of each
getFileSize() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
getFileSize() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
This is more of size in bytes of buffered records.
getFirstOffset() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
getFlushTime() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
getFlushTime() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getFlushTimeThresholdSeconds() - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
 
getIngestManager() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
getInternalStage() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
getLastOffset() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
getLatestConsumerOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 
getLatestConsumerOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getMessage() - Method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
getMessageByCode(Long) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
getMetricName() - Method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
 
getMetricRegistry() - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
 
getMetricRegistry(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
getMetricRegistry(String) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getMetricsJmxReporter() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
Gets the JMX metrics reporter
getNumOfRecords() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
getObjectNode() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
 
getObjectNode() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
Get default object Node which will be part of every telemetry being sent to snowflake.
getObjectNode() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceV1
 
getOffset(TopicPartition) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
retrieve offset of last loaded record for given pipe name
getOffset(TopicPartition) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getOffsetPersistedInSnowflake() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 
getOffsetPersistedInSnowflake() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getOffsetSafeToCommitToKafka() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Get committed offset from Snowflake.
getPartitionCount() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
get the number of partitions assigned to this sink service
getPartitionCount() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getPreviousFlushTimeStampMs() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getProcessedOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 
getProcessedOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getProcessedRecordForSnowpipe(SinkRecord) - Method in class com.snowflake.kafka.connector.records.RecordService
Given a single Record from put API, process it and convert it into a Json String.
getProcessedRecordForStreamingIngest(SinkRecord) - Method in class com.snowflake.kafka.connector.records.RecordService
Given a single Record from put API, process it and convert it into Map of String and Object.
getProperties() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
getRecordNumber() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
getRecordNumber() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getResponseCode() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
 
getResponseMessage() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
 
getScheme() - Method in class com.snowflake.kafka.connector.internal.SnowflakeURL
 
getSinkRecord(long) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
 
getSinkRecords() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
TODO:SNOW-552576 Avoid extra memory in buffer.
getSinkRecords() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
 
getSnowflakeConnection() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
Return an instance of SnowflakeConnection if it was set previously by calling Start().
getSnowflakeOAuthAccessToken(SnowflakeURL, String, String, String) - Static method in class com.snowflake.kafka.connector.Utils
Get OAuth access token given refresh token
getSnowflakeOAuthToken(SnowflakeURL, String, String, String, String, String, String) - Static method in class com.snowflake.kafka.connector.Utils
Get OAuth token given integration info Snowflake OAuth Overview
getSnowflakeTelemetryChannelStatus() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getStageName() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
 
getStageName() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
getStageType(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
Get the backend stage type, S3, Azure or GCS.
getStatusCode() - Method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
getStreamingBuffer() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getStreamingClientProviderForTests(SnowflakeStreamingIngestClient, StreamingClientHandler) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
ONLY FOR TESTING - to get a provider with injected properties
getStreamingClientProviderInstance() - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
Gets the current streaming provider
getStreamingIngestClient() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
getTelemetryClient() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
 
getTelemetryClient() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
getTelemetryServiceV2() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
getTopicPartitionChannelFromCacheKey(String) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Used for testing Only
GRANT_TYPE_PARAM - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 

H

hasSchemaEvolutionPermission(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Check whether the user has the role privilege to do schema evolution and whether the schema evolution option is enabled on the table
hasSchemaEvolutionPermission(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
Check whether the user has the role privilege to do schema evolution and whether the schema evolution option is enabled on the table
HTTP_NON_PROXY_HOSTS - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTP_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTP_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTP_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTP_PROXY_USER - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTP_USE_PROXY - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTPS_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTPS_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTPS_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.Utils
 
HTTPS_PROXY_USER - Static variable in class com.snowflake.kafka.connector.Utils
 

I

IGNORE - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
 
incrementAndGetCleanerRestartCount() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
info(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
Logs an info level message
ingestFile(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
Ingest single file
ingestFile(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
ingestFiles(List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
Ingest a list of files
ingestFiles(List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
INGESTION_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
Time difference between file being uploaded to internal stage to time knowing the successful file ingestion status through insertReport or loadHistoryScan API.
INGESTION_METHOD_DEFAULT_SNOWPIPE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
INGESTION_METHOD_OPT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
IngestionMethodConfig - Enum in com.snowflake.kafka.connector.internal.streaming
Enum representing the allowed values for config SnowflakeSinkConnectorConfig.INGESTION_METHOD_OPT
insert(Collection<SinkRecord>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
call pipe to insert a collections of JSON records will trigger time based flush
insert(Collection<SinkRecord>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Inserts the given record into buffer and then eventually calls insertRows API if buffer threshold has reached.
insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
Inserts the row into Buffer.
insert(SinkRecord) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
call pipe to insert a JSON record will not trigger time based flush
insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Inserts individual records into buffer.
insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
 
INSERT_FILES_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
INSERT_REPORT_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
insertBufferedRecordsIfFlushTimeThresholdReached() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
If difference between current time and previous flush time is more than threshold, insert the buffered Rows.
insertRecordToBuffer(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Inserts the record into buffer
InternalUtils - Class in com.snowflake.kafka.connector.internal
 
InternalUtils() - Constructor for class com.snowflake.kafka.connector.internal.InternalUtils
 
InternalUtils.backoffFunction - Interface in com.snowflake.kafka.connector.internal
Interfaces to define the lambda function to be used by backoffAndRetry
IS_CHANNEL_CLOSING - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
 
IS_PIPE_CLOSING - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
 
IS_REUSE_PIPE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
IS_REUSE_STAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
IS_REUSE_TABLE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
isBroken() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
 
isChannelClosed() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
isChannelMigrationResponseSuccessful(ChannelMigrateOffsetTokenResponseDTO) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
Given a Response DTO, which was received from server side and serialized, check if it as successful migration or a failure.
isClientValid(SnowflakeStreamingIngestClient) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
Checks if a given client is valid (not null, open and has a name)
isClosed() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
 
isClosed() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
isClosed() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
retrieve sink service status
isClosed() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
isOptional() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
isPartitionBufferEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
isPipeCompatible(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check snowpipe definition
isPipeCompatible(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
isRecordContentValueNull() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
Check if primary reason for this record content's value to be an empty json String, a null value?
isSingleFieldValid(Config) - Static method in class com.snowflake.kafka.connector.Utils
 
isStageCompatible(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Examine all file names matches our pattern
isStageCompatible(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
isTableCompatible(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Check the given table has correct schema correct schema: (record_metadata variant, record_content variant)
isTableCompatible(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 

J

JAVA_IO_TMPDIR - Static variable in class com.snowflake.kafka.connector.Utils
 
JDK_HTTP_AUTH_TUNNELING - Static variable in class com.snowflake.kafka.connector.Utils
 
JMX_METRIC_PREFIX - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
JMX_OPT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JMX_OPT_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JVM_NON_PROXY_HOSTS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JVM_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JVM_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JVM_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
JVM_PROXY_USERNAME - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 

K

KAFKA_CHANNEL_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_CHANNEL_USAGE - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_FATAL_ERROR - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
Time difference between the record put into kafka to record fetched into Kafka Connector Can be null if the value was not set inside a record.
KAFKA_PIPE_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_PIPE_USAGE - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KAFKA_STOP - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
KafkaProviderValidator() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
 
KafkaRecordErrorReporter - Interface in com.snowflake.kafka.connector.dlq
This interface is a wrapper on top of ErrantRecordReporter.
KCLogger - Class in com.snowflake.kafka.connector.internal
Logger for Snowflake Sink Connector.
KCLogger(String) - Constructor for class com.snowflake.kafka.connector.internal.KCLogger
Create and return a new logging handler
KEY_CONVERTER_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
Used to serialize the incoming records to kafka connector.
keySchema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 

L

LATENCY_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
LATEST_CONSUMER_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
LATEST_CONSUMER_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
listStage(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
list a non table stage and return a list of file names contained in given subdirectory
listStage(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
listStage(String, String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
list a stage and return a list of file names contained in given subdirectory
listStage(String, String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
LOAD_HISTORY_SCAN_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
logErrors(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
LOGGER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
 
LOGGER - Static variable in class com.snowflake.kafka.connector.records.SnowflakeConverter
 

M

MAX_GET_OFFSET_TOKEN_RETRIES - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
MAX_RECORD_OVERHEAD_BYTES - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
MDC_CONN_CTX_KEY - Static variable in class com.snowflake.kafka.connector.internal.KCLogger
 
MEMORY_USAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
MetricsJmxReporter - Class in com.snowflake.kafka.connector.internal.metrics
Helper class for creation of JMX Metrics from metrics registry, also includes a definition to create an ObjectName used to register a Metric
MetricsJmxReporter(MetricRegistry, String) - Constructor for class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
 
MetricsUtil - Class in com.snowflake.kafka.connector.internal.metrics
All metrics related constants.
MetricsUtil() - Constructor for class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
MetricsUtil.EventType - Enum in com.snowflake.kafka.connector.internal.metrics
 
migrateStreamingChannelOffsetToken(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Migrate Streaming Channel offsetToken from a source Channel to a destination channel.
migrateStreamingChannelOffsetToken(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
moveToTableStage(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
move all files on stage related to given pipe to table stage
moveToTableStage(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
moveToTableStage(String, String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
 
moveToTableStage(String, String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 

N

name() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
NAME - Static variable in class com.snowflake.kafka.connector.Utils
 
names() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
 
names() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
 
NO_OFFSET_TOKEN_REGISTERED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
NON_AVRO_SCHEMA - Static variable in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
 
NONE - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
Tolerate no errors.
NUM_METRICS - Static variable in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
 

O

OAUTH - Static variable in class com.snowflake.kafka.connector.Utils
 
OAUTH_CONTENT_TYPE_HEADER - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
OAuthConstants - Class in com.snowflake.kafka.connector.internal
This class contains constants for OAuth request.
OAuthConstants() - Constructor for class com.snowflake.kafka.connector.internal.OAuthConstants
 
of(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
 
OFFSET_MIGRATION_SOURCE_AND_DESTINATION_CHANNEL_SAME - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
OFFSET_MIGRATION_SOURCE_CHANNEL_DOES_NOT_EXIST - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
OFFSET_PERSISTED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
See TopicPartitionChannel for offset description
OFFSET_PERSISTED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
OFFSET_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
 
open(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
init ingestion task in Sink service

P

parameters() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
parseEncryptedPrivateKey(String, String) - Static method in class com.snowflake.kafka.connector.internal.EncryptionUtils
 
parseTopicToTableMap(String) - Static method in class com.snowflake.kafka.connector.Utils
 
PartitionBuffer<T> - Class in com.snowflake.kafka.connector.internal
Abstract class which holds buffered data per partition including its start offset, end offset, size.
PartitionBuffer() - Constructor for class com.snowflake.kafka.connector.internal.PartitionBuffer
Public constructor.
partitionChannelKey(String, int) - Static method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Gets a unique identifier consisting of topic name and partition number.
PIPE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
pipeExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check pipe existence
pipeExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
pipeName(String, String, int) - Static method in class com.snowflake.kafka.connector.Utils
generate pipe name by given table and partition
preCommit(Map<TopicPartition, OffsetAndMetadata>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
Sync committed offsets
PRIVATE_KEY_PASSPHRASE - Static variable in class com.snowflake.kafka.connector.Utils
 
PROCESSED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Offset number that is most recent inside the buffer (In memory buffer)
PROCESSED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
PROVIDER_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
PROVIDER_NAMES - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
 
PURGED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
Offsets which are being purged from internal stage.
PURGED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
purgeStage(String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
purge files from given stage
purgeStage(String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
put(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
Deprecated.
put(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
Deprecated.
put(Collection<SinkRecord>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
ingest records to Snowflake
putToTableStage(String, String, byte[]) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
put a file to table stage
putToTableStage(String, String, byte[]) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
putWithCache(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
put a file to stage.
putWithCache(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
putWithCache(String, String, String, StageInfo.StageType) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
Upload file to internal stage with previously cached credentials.

Q

quoteNameIfNeeded(String) - Static method in class com.snowflake.kafka.connector.Utils
Quote the column name if needed: When there is quote already, we do nothing; otherwise we convert the name to upper case and add quote

R

READER_SCHEMA - Static variable in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
 
readIngestReport(List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
retrieve status of given files from the ingest report
readIngestReport(List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
readOneHourHistory(List<String>, long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
retrieve status of given files from load history in one hour time window
readOneHourHistory(List<String>, long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
REBALANCING - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
REBALANCING_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
RECORD_NUMBER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
RecordService - Class in com.snowflake.kafka.connector.records
 
RecordService() - Constructor for class com.snowflake.kafka.connector.records.RecordService
Record service with null telemetry Service, only use it for testing.
RecordService(SnowflakeTelemetryService) - Constructor for class com.snowflake.kafka.connector.records.RecordService
process records output JSON format: { "meta": { "offset": 123, "topic": "topic name", "partition": 123, "key":"key name" } "content": "record content" }
REDIRECT_URI - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
refreshCredentials(String, StageInfo.StageType, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
 
REMOVE_FILE_FROM_INTERNAL_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
removeMetricsFromRegistry(String) - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
Unregister all snowflake KC related metrics from registry
reportError(SinkRecord, Exception) - Method in interface com.snowflake.kafka.connector.dlq.KafkaRecordErrorReporter
 
reportKafkaConnectFatalError(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
Event of a fatal error in the connector
reportKafkaConnectStart(long, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
Event of connector start
reportKafkaConnectStop(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
Event of connector stop
reportKafkaPartitionStart(SnowflakeTelemetryBasicInfo) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
report connector partition start
reportKafkaPartitionUsage(SnowflakeTelemetryBasicInfo, boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
report connector's partition usage.
resetMemoryUsage() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 

S

schema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
schemaExists(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check if a given schema exists
schemaExists(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
SchematizationUtils - Class in com.snowflake.kafka.connector.internal.streaming
This is a class containing the helper functions related to schematization
SchematizationUtils() - Constructor for class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
 
SELF_HOSTED - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
 
send(SnowflakeTelemetryService.TelemetryType, JsonNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
JsonNode data is wrapped into another ObjectNode which looks like this:
setAndGetEnableSchematizationFromConfig(Map<String, String>) - Method in class com.snowflake.kafka.connector.records.RecordService
extract enableSchematization from the connector config and set the value for the recordService
setAppName(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
set app name
setAppName(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
 
setAverageCommitLagFileCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setAverageCommitLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setAverageIngestionLagFileCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setAverageIngestionLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setAverageKafkaLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setAverageKafkaLagRecordCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setBehaviorOnNullValues(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.records.RecordService
Directly set the behaviorOnNullValues through param
setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setBufferSizeBytes(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
setCleanerRestartCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setCommittedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setConnectorName(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
setCustomJMXMetrics(boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
setCustomJMXMetrics(boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setCustomJMXMetrics(boolean) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setDefaultValues(Map<String, String>) - Static method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
setEnableSchematization(boolean) - Method in class com.snowflake.kafka.connector.records.RecordService
Directly set the enableSchematization through param
setErrorReporter(KafkaRecordErrorReporter) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
setErrorReporter(KafkaRecordErrorReporter) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setErrorReporter(KafkaRecordErrorReporter) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setFileCountReprocessPurge(int) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setFileCountRestart(int) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setFileSize(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
change data size of buffer to control the flush rate, the minimum file size is controlled by SnowflakeSinkConnectorConfig.BUFFER_SIZE_BYTES_MIN
setFileSize(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setFileSize(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Assume this is buffer size in bytes, since this is streaming ingestion
setFirstOffset(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
setFlushedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setFlushTime(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
change flush rate of sink service the minimum flush time is controlled by SnowflakeSinkConnectorConfig.BUFFER_FLUSH_TIME_SEC_MIN
setFlushTime(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setFlushTime(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setIsStoppedToTrue() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
close all cleaner thread but have no effect on sink service context
setIsStoppedToTrue() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setJDBCLoggingDirectory() - Static method in class com.snowflake.kafka.connector.Utils
Read JDBC logging directory from environment variable JDBC_LOG_DIR and set that in System property
setLastOffset(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
setLatestConsumerOffset(long) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
setMetadataConfig(SnowflakeMetadataConfig) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
set the metadata config to let user control what metadata to be collected into SF db
setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.records.RecordService
 
setNumOfRecords(int) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
setProcessedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
setProperties(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
setProperties(Properties) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
setPurgedOffsetAtomically(LongUnaryOperator) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
Either keeps the same offset or updates the purgedOffset if a higher value offset is found in insertReport Snowpipe API
setRecordNumber(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
change maximum number of record cached in buffer to control the flush rate, 0 for unlimited
setRecordNumber(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setRecordNumber(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setReusePipe(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setReuseStage(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setReuseTable(boolean) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
 
setReuseTable(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setSinkTaskContext(SinkTaskContext) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
 
setSinkTaskContext(SinkTaskContext) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
Set SinkTaskContext for the respective SnowflakeSinkService instance at runtime.
setSinkTaskContext(SinkTaskContext) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setStartTime(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
set task id
setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
 
setTelemetry(SnowflakeTelemetryService) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
Set telemetry client
setTelemetry(SnowflakeTelemetryService) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
 
setTopic2TableMap(Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
pass topic to table map to sink service
setTopic2TableMap(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
 
setTopic2TableMap(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
setURL(SnowflakeURL) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
SF_AUTHENTICATOR - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_DATABASE - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_OAUTH_CLIENT_ID - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_OAUTH_CLIENT_SECRET - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_OAUTH_REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_PRIVATE_KEY - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_ROLE - Static variable in class com.snowflake.kafka.connector.Utils
This value should be present if ingestion method is IngestionMethodConfig.SNOWPIPE_STREAMING
SF_SCHEMA - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_SSL - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_URL - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_USER - Static variable in class com.snowflake.kafka.connector.Utils
 
SF_WAREHOUSE - Static variable in class com.snowflake.kafka.connector.Utils
 
shouldFlushOnBufferByteSize(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
Returns true the buffer should flush based on the current buffer byte size
shouldFlushOnBufferRecordCount(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
Returns true the buffer should flush based on the current buffer record count
shouldFlushOnBufferTime(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
Returns true the buffer should flush based on the last flush time
shouldSkipNullValue(SinkRecord, SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.records.RecordService
Returns true if we want to skip this record since the value is null or it is an empty json string.
SNOWFLAKE_JDBC_TRACE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_JWT - Static variable in class com.snowflake.kafka.connector.Utils
 
SNOWFLAKE_METADATA_ALL - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_METADATA_CREATETIME - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_METADATA_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_METADATA_OFFSET_AND_PARTITION - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_METADATA_TOPIC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SNOWFLAKE_ROLE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SnowflakeAvroConverter - Class in com.snowflake.kafka.connector.records
 
SnowflakeAvroConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
 
SnowflakeAvroConverterWithoutSchemaRegistry - Class in com.snowflake.kafka.connector.records
 
SnowflakeAvroConverterWithoutSchemaRegistry() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeAvroConverterWithoutSchemaRegistry
 
SnowflakeConnectionService - Interface in com.snowflake.kafka.connector.internal
 
SnowflakeConnectionServiceBuilder() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
 
SnowflakeConnectionServiceFactory - Class in com.snowflake.kafka.connector.internal
 
SnowflakeConnectionServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory
 
SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder - Class in com.snowflake.kafka.connector.internal
 
SnowflakeConnectionServiceV1 - Class in com.snowflake.kafka.connector.internal
Implementation of Snowflake Connection Service interface which includes all handshake between KC and SF through JDBC connection.
SnowflakeConverter - Class in com.snowflake.kafka.connector.records
Snowflake Converter
SnowflakeConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeConverter
 
SnowflakeErrors - Enum in com.snowflake.kafka.connector.internal
 
SnowflakeIngestionService - Interface in com.snowflake.kafka.connector.internal
Ingestion service manages snow pipe
SnowflakeIngestionServiceFactory - Class in com.snowflake.kafka.connector.internal
A factory to create SnowflakeIngestionService
SnowflakeIngestionServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceFactory
 
SnowflakeIngestionServiceV1 - Class in com.snowflake.kafka.connector.internal
Implementation of Snowpipe API calls.
SnowflakeInternalOperations - Enum in com.snowflake.kafka.connector.internal
Enum placeholders for internal operations.
SnowflakeInternalStage - Class in com.snowflake.kafka.connector.internal
Implementation of put API through JDBC's API uploadWithoutConnection.
SnowflakeInternalStage(SnowflakeConnectionV1, long, Properties) - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
 
SnowflakeJsonConverter - Class in com.snowflake.kafka.connector.records
 
SnowflakeJsonConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeJsonConverter
 
SnowflakeJsonSchema - Class in com.snowflake.kafka.connector.records
Snowflake json schema
SnowflakeJsonSchema() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
SnowflakeKafkaConnectorException - Exception in com.snowflake.kafka.connector.internal
 
SnowflakeKafkaConnectorException(String, String) - Constructor for exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
 
SnowflakeMetadataConfig - Class in com.snowflake.kafka.connector.records
 
SnowflakeMetadataConfig() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
initialize with default config
SnowflakeMetadataConfig(Map<String, String>) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
set flag to false only if metadata config is set to false in config
SnowflakeRecordContent - Class in com.snowflake.kafka.connector.records
 
SnowflakeRecordContent() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
Constructor for null value.
SnowflakeRecordContent(byte[]) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
constructor for broken record
SnowflakeRecordContent(JsonNode) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
constructor for json converter
SnowflakeRecordContent(Schema, Object) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
constructor for native json converter
SnowflakeSinkConnector - Class in com.snowflake.kafka.connector
SnowflakeSinkConnector implements SinkConnector for Kafka Connect framework.
SnowflakeSinkConnector() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnector
No-Arg constructor.
SnowflakeSinkConnectorConfig - Class in com.snowflake.kafka.connector
SnowflakeSinkConnectorConfig class is used for specifying the set of expected configurations.
SnowflakeSinkConnectorConfig() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
SnowflakeSinkConnectorConfig.BehaviorOnNullValues - Enum in com.snowflake.kafka.connector
 
SnowflakeSinkConnectorConfig.ErrorTolerance - Enum in com.snowflake.kafka.connector
 
SnowflakeSinkConnectorConfig.KafkaProvider - Enum in com.snowflake.kafka.connector
 
SnowflakeSinkConnectorConfig.KafkaProviderValidator - Class in com.snowflake.kafka.connector
 
SnowflakeSinkConnectorConfig.TopicToTableValidator - Class in com.snowflake.kafka.connector
 
SnowflakeSinkService - Interface in com.snowflake.kafka.connector.internal
Background service of data sink, responsible to create/drop pipe and ingest/purge files
SnowflakeSinkServiceFactory - Class in com.snowflake.kafka.connector.internal
A factory to create SnowflakeSinkService
SnowflakeSinkServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
 
SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder - Class in com.snowflake.kafka.connector.internal
Builder class to create instance of SnowflakeSinkService
SnowflakeSinkServiceV2 - Class in com.snowflake.kafka.connector.internal.streaming
This is per task configuration.
SnowflakeSinkServiceV2(long, long, long, SnowflakeConnectionService, RecordService, SnowflakeTelemetryService, Map<String, String>, SnowflakeSinkConnectorConfig.BehaviorOnNullValues, boolean, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeStreamingIngestClient, Map<String, String>, boolean, Map<String, TopicPartitionChannel>) - Constructor for class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
SnowflakeSinkServiceV2(SnowflakeConnectionService, Map<String, String>) - Constructor for class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
 
SnowflakeSinkTask - Class in com.snowflake.kafka.connector
SnowflakeSinkTask implements SinkTask for Kafka Connect framework.
SnowflakeSinkTask() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
default constructor, invoked by kafka connect framework
SnowflakeSinkTask(SnowflakeSinkService, SnowflakeConnectionService) - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
 
SnowflakeSinkTask(SnowflakeSinkService, SnowflakeConnectionService, Map<String, String>) - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
 
SnowflakeTelemetryBasicInfo - Class in com.snowflake.kafka.connector.internal.telemetry
Minimum information needed to sent to Snowflake through Telemetry API
SnowflakeTelemetryBasicInfo(String, SnowflakeTelemetryService.TelemetryType) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
Base Constructor.
SnowflakeTelemetryChannelCreation - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
This object is sent only once when a channel starts.
SnowflakeTelemetryChannelCreation(String, String, long) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
 
SnowflakeTelemetryChannelStatus - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
Extension of SnowflakeTelemetryBasicInfo class used to send data to snowflake when the TopicPartitionChannel closes.
SnowflakeTelemetryChannelStatus(String, String, String, long, boolean, MetricsJmxReporter, AtomicLong, AtomicLong, AtomicLong) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
Creates a new object tracking TopicPartitionChannel metrics with JMX and send telemetry data to snowflake
SnowflakeTelemetryPipeCreation - Class in com.snowflake.kafka.connector.internal.telemetry
This object is send only once when pipe starts No concurrent modification is made on this object, thus no lock is required.
SnowflakeTelemetryPipeCreation(String, String, String) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
 
SnowflakeTelemetryPipeStatus - Class in com.snowflake.kafka.connector.internal.telemetry
Extension of SnowflakeTelemetryBasicInfo class used to send data to snowflake periodically.
SnowflakeTelemetryPipeStatus(String, String, String, boolean, MetricsJmxReporter) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
 
SnowflakeTelemetryService - Class in com.snowflake.kafka.connector.internal.telemetry
Abstract class handling basics of sending telemetry information to snowflake.
SnowflakeTelemetryService() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
 
SnowflakeTelemetryService.TelemetryType - Enum in com.snowflake.kafka.connector.internal.telemetry
 
SnowflakeTelemetryServiceBuilder(Connection, IngestionMethodConfig) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
 
SnowflakeTelemetryServiceFactory - Class in com.snowflake.kafka.connector.internal.telemetry
Factory class which produces the telemetry service which essentially has a telemetry client instance.
SnowflakeTelemetryServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory
 
SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder - Class in com.snowflake.kafka.connector.internal.telemetry
Builder for TelemetryService
SnowflakeTelemetryServiceV1 - Class in com.snowflake.kafka.connector.internal.telemetry
Implementation of Snowflake Telemetry Service specific for Snowpipe telemetries.
SnowflakeTelemetryServiceV2 - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
This is the implementation of Telemetry Service for Snowpipe Streaming.
SnowflakeTelemetryServiceV2(Connection) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
Constructor for TelemetryService which is used by Snowpipe Streaming.
SnowflakeTelemetryServiceV2(Telemetry) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
 
SnowflakeURL - Class in com.snowflake.kafka.connector.internal
Snowflake URL Object https://account.region.snowflakecomputing.com:443
SnowflakeURL(String) - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeURL
 
SNOWPIPE - com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
 
SNOWPIPE_STREAMING - com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
 
SNOWPIPE_STREAMING_FILE_VERSION - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
STAGE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
stageExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check stage existence
stageExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
stageName(String, String) - Static method in class com.snowflake.kafka.connector.Utils
generate stage name by given table
start() - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
This function will internally register all metrics present inside metric registry and will register mbeans to the mbeanserver
start(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
start method will only be called on a clean connector, i.e.
start(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
start method handles configuration parsing and one-time setup of the task.
START_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
startPartition(String, TopicPartition) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
Start the Task.
startPartition(String, TopicPartition) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Creates a table if it doesnt exist in Snowflake.
startPartitions(Collection<TopicPartition>, Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
Start a collection of TopicPartition.
startPartitions(Collection<TopicPartition>, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
Initializes multiple Channels and partitionsToChannel maps with new instances of TopicPartitionChannel
stop() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
Stop method will be called to stop a connector, cleans up snowflake internal stages, after making sure that there are no pending files to ingest.
stop() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
stop method is invoked only once outstanding calls to other methods have completed.
STREAMING_BUFFER_BYTES_DEFAULT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
Keeping this default as ~ 20MB.
STREAMING_BUFFER_COUNT_RECORDS_DEFAULT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_BUFFER_FLUSH_TIME_DEFAULT_SEC - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_BUFFER_FLUSH_TIME_MINIMUM_SEC - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_AUTHORIZATION_TYPE - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_JWT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_OAUTH - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_OAUTH_CLIENT_ID - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_OAUTH_CLIENT_SECRET - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
STREAMING_CONSTANT_OAUTH_REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
StreamingBufferThreshold - Class in com.snowflake.kafka.connector.internal.streaming
Helper class Associated to Streaming Snowpipe runtime of Kafka Connect which can help to identify if there is a need to flush the buffered records.
StreamingBufferThreshold(long, long, long) - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingBufferThreshold
 
StreamingClientHandler - Class in com.snowflake.kafka.connector.internal.streaming
This class handles all calls to manage the streaming ingestion client
StreamingClientHandler() - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
 
StreamingClientProvider - Class in com.snowflake.kafka.connector.internal.streaming
Factory that provides the streaming client(s).
StreamingUtils - Class in com.snowflake.kafka.connector.internal.streaming
 
StreamingUtils() - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
SUCCESS - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 

T

TABLE_COLUMN_CONTENT - Static variable in class com.snowflake.kafka.connector.Utils
 
TABLE_COLUMN_METADATA - Static variable in class com.snowflake.kafka.connector.Utils
 
TABLE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
tableExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
check table existence
tableExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
tableName - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
 
tableName(String, Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
verify topic name, and generate valid table name
TASK_ID - Static variable in class com.snowflake.kafka.connector.Utils
 
taskClass() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
 
taskConfigs(int) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
taskConfigs method returns a set of configurations for SinkTasks based on the current configuration, producing at most 'maxTasks' configurations
telemetry - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
 
TelemetryConstants - Class in com.snowflake.kafka.connector.internal.telemetry
Placeholder for all constants used for Sending information from Connector to Snowflake through Telemetry API
TelemetryConstants() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
telemetryType - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
 
TIME_FORMAT - Static variable in class com.snowflake.kafka.connector.records.RecordService
 
toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
cast bytes array to JsonNode array
toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverterWithoutSchemaRegistry
Parse Avro record without schema
toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonConverter
cast bytes array to Json array
toggleGlobalMdcLoggingContext(boolean) - Static method in class com.snowflake.kafka.connector.internal.KCLogger
Enable or disables the MDC context.
TOKEN_REQUEST_ENDPOINT - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
 
tolerateErrors(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
 
TOPIC_PARTITION_CHANNEL_CLOSE_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
TOPIC_PARTITION_CHANNEL_CREATION_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
TOPIC_PARTITION_CHANNEL_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
 
TopicPartitionChannel - Class in com.snowflake.kafka.connector.internal.streaming
This is a wrapper on top of Streaming Ingest Channel which is responsible for ingesting rows to Snowflake.
TopicPartitionChannel(SnowflakeStreamingIngestClient, TopicPartition, String, String, boolean, BufferThreshold, Map<String, String>, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeConnectionService, RecordService, SnowflakeTelemetryService, boolean, MetricsJmxReporter) - Constructor for class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
TopicPartitionChannel(SnowflakeStreamingIngestClient, TopicPartition, String, String, BufferThreshold, Map<String, String>, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeConnectionService, SnowflakeTelemetryService) - Constructor for class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
Testing only, initialize TopicPartitionChannel without the connection service
TopicPartitionChannel.StreamingBuffer - Class in com.snowflake.kafka.connector.internal.streaming
A buffer which holds the rows before calling insertRows API.
TopicPartitionChannelInsertionException - Exception in com.snowflake.kafka.connector.internal.streaming
Class for exceptions that occur while interacting with Snowflake through Snowpipe Streaming.
TopicPartitionChannelInsertionException(String, Throwable) - Constructor for exception com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannelInsertionException
 
TOPICS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
TopicToTableValidator() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
 
toString() - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
 
toString() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
 
toString() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
 
toString() - Method in class com.snowflake.kafka.connector.internal.SnowflakeURL
 
toString() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
 
toString() - Method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
 
toString() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
 
toString() - Method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
 
toString() - Method in class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
 
toString() - Method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
 
toString() - Method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
 
toString() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
 
toString() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
 
trace(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
Logs an trace level message
tryUnregisterChannelJMXMetrics() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
Unregisters the JMX metrics if possible
type() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 

U

UNKNOWN - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
 
UNKNOWN_STATUS_MESSAGE - Static variable in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
 
updateBrokenRecordMetrics(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
When either key or value is broken.
updateCommitLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
Commit Lag is time between kafka connector commits the after calling insertFiles API and time file was flushed into internal stage.
updateConfigErrorMessage(Config, String, String) - Static method in class com.snowflake.kafka.connector.Utils
 
updateFailedIngestionMetrics(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
When Ingestion status of n number of files is not found/failed.
updateIngestionLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
Ingestion Lag is time between kafka connector flushes the file and time file was first found from insertReport/loadHistory API.
updateKafkaLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
Kafka Lag is time between kafka connector sees the record and time record was inserted into kafka.
UPLOAD_FILE_TO_INTERNAL_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
UPLOAD_FILE_TO_INTERNAL_STAGE_NO_CONNECTION - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
UPLOAD_FILE_TO_TABLE_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
 
USER_AGENT_SUFFIX_FORMAT - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
 
Utils - Class in com.snowflake.kafka.connector
Various arbitrary helper functions
Utils() - Constructor for class com.snowflake.kafka.connector.Utils
 

V

validate(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
 
validateBufferThreshold(Map<String, String>, IngestionMethodConfig) - Static method in class com.snowflake.kafka.connector.internal.BufferThreshold
Check if provided snowflake kafka connector buffer properties are within permissible values.
validateConfigToMap(Config) - Static method in class com.snowflake.kafka.connector.Utils
 
validateStreamingSnowpipeConfig(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
Validate Streaming snowpipe related config provided by config(customer's config)
VALIDATOR - Static variable in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
 
VALIDATOR - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
 
VALIDATOR - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
Validator to validate behavior.on.null.values which says whether kafka should keep null value records or ignore them while ingesting into snowflake table.
VALUE_CONVERTER_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
VALUE_SCHEMA_REGISTRY_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
 
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
Returns the enum constant of this type with the specified name.
values() - Static method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
Returns an array containing the constants of this enum type, in the order they are declared.
valueSchema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
version() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
 
version() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
 
version() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
 
VERSION - Static variable in class com.snowflake.kafka.connector.Utils
 

W

warn(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
Logs an warn level message
A B C D E F G H I J K L M N O P Q R S T U V W 
All Classes All Packages