A B C D E F G H I J K L M N O P Q R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- ACCESS_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- addAndGetFileCountOnIngestion(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addAndGetFileCountOnStage(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addAndGetFileCountPurged(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addAndGetMemoryUsage(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addAndGetTotalNumberOfRecord(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addAndGetTotalSizeOfData(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- addTask(String, TopicPartition) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
-
Add task for table and TopicPartition.
- addUserConnectorPropertiesToDataNode(Map<String, String>, ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
Adds specific user provided connector properties to ObjectNode
- ALL - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
-
Tolerate all errors.
- allIngestionTypes() - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
- alterNonNullableColumns(String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Alter table to drop non-nullability of a list of columns
- alterNonNullableColumns(String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
-
Alter table to drop non-nullability of a list of columns
- appendColumnsToTable(String, Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Alter table to add columns according to a map from columnNames to their types
- appendColumnsToTable(String, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
-
Alter table to add columns according to a map from columnNames to their types
- appendMetaColIfNotExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Append a VARIANT type column "RECORD_METADATA" to the table if it is not present.
- appendMetaColIfNotExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- apply() - Method in interface com.snowflake.kafka.connector.internal.InternalUtils.backoffFunction
- AVERAGE_COMMIT_LAG_FILE_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- AVERAGE_COMMIT_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- AVERAGE_INGESTION_LAG_FILE_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- AVERAGE_INGESTION_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- AVERAGE_KAFKA_LAG_MS - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- AVERAGE_KAFKA_LAG_RECORD_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
B
- backoffAndRetry(SnowflakeTelemetryService, SnowflakeInternalOperations, InternalUtils.backoffFunction) - Static method in class com.snowflake.kafka.connector.internal.InternalUtils
-
Backoff logic
- backoffSec - Static variable in class com.snowflake.kafka.connector.internal.InternalUtils
- BASIC_AUTH_HEADER_PREFIX - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- BEHAVIOR_ON_NULL_VALUES_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BOOLEAN_VALIDATOR - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
-
Boolean Validator of passed booleans in configurations (TRUE or FALSE).
- BREAK_ON_SCHEMA_REGISTRY_ERROR - Static variable in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
- BUFFER_COUNT_RECORDS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_COUNT_RECORDS_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_COUNT_RECORDS_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_FLUSH_TIME_SEC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_FLUSH_TIME_SEC_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_FLUSH_TIME_SEC_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_RECORD_COUNT - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- BUFFER_SIZE_BYTES - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- BUFFER_SIZE_BYTES - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_SIZE_BYTES_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_SIZE_BYTES_MIN - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- BUFFER_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- BufferThreshold - Class in com.snowflake.kafka.connector.internal
-
Helper class associated to runtime of Kafka Connect which can help to identify if there is a need to flush the buffered records.
- BufferThreshold(IngestionMethodConfig, long, long, long) - Constructor for class com.snowflake.kafka.connector.internal.BufferThreshold
-
Public constructor
- build() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- build() - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- build() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
- builder() - Static method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory
- builder(SnowflakeConnectionService) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
-
Basic builder which internally uses SinkServiceV1 (Snowpipe)
- builder(SnowflakeConnectionService, IngestionMethodConfig, Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
-
create service builder.
- builder(String, String, String, int, String, String, String, PrivateKey, String) - Static method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceFactory
- builder(Connection, IngestionMethodConfig) - Static method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory
- buildIngestService(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
build ingest service instance for given stage and pipe
- buildIngestService(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- buildOAuthHttpPostRequest(SnowflakeURL, String, Map<String, String>, StringEntity) - Static method in class com.snowflake.kafka.connector.Utils
-
Build OAuth http post request base on headers and payload
- BYTE_NUMBER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
C
- callAllGetOffset() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
used for testing only
- callAllGetOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- CHANNEL_OFFSET_TOKEN_MIGRATION_GENERAL_EXCEPTION - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- ChannelMigrateOffsetTokenResponseDTO - Class in com.snowflake.kafka.connector.internal.streaming
-
POJO used to serialize the System function response for migration offset from Source Channel to Destination.
- ChannelMigrateOffsetTokenResponseDTO() - Constructor for class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
-
Default Ctor for Jackson
- ChannelMigrateOffsetTokenResponseDTO(long, String) - Constructor for class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
- ChannelMigrationResponseCode - Enum in com.snowflake.kafka.connector.internal.streaming
-
Response code sent from the system function to migrate offsets from Source to Destination Channel.
- checkErrorCode(SnowflakeErrors) - Method in exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
- CLEANER_RESTART_COUNT - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- close() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Close Connection
- close() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- close() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
close ingest service
- close() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- close(Collection<TopicPartition>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
terminate given topic partitions
- close(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
This function is called during rebalance.
- close(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
Closes sink service
- closeAll() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
terminate all tasks and close this service instance
- closeAll() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- closeChannel() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Close channel associated to this partition Not rethrowing connect exception because the connector will stop.
- closeClient(SnowflakeStreamingIngestClient) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
-
Closes the given client.
- closeClient(SnowflakeStreamingIngestClient) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
-
Closes the given client
- com.snowflake.kafka.connector - package com.snowflake.kafka.connector
- com.snowflake.kafka.connector.dlq - package com.snowflake.kafka.connector.dlq
- com.snowflake.kafka.connector.internal - package com.snowflake.kafka.connector.internal
- com.snowflake.kafka.connector.internal.metrics - package com.snowflake.kafka.connector.internal.metrics
- com.snowflake.kafka.connector.internal.streaming - package com.snowflake.kafka.connector.internal.streaming
- com.snowflake.kafka.connector.internal.streaming.telemetry - package com.snowflake.kafka.connector.internal.streaming.telemetry
- com.snowflake.kafka.connector.internal.telemetry - package com.snowflake.kafka.connector.internal.telemetry
- com.snowflake.kafka.connector.records - package com.snowflake.kafka.connector.records
- COMMIT_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
-
Time difference between file being uploaded to internal stage to time invoking insertFiles API.
- COMMITTED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Offset number (Record) for which precommit
SinkTask.preCommit(Map)API was called and we called snowpipe's insertFiles API. - COMMITTED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- config() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
- configure(Map<String, ?>, boolean) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
- configure(Map<String, ?>, boolean) - Method in class com.snowflake.kafka.connector.records.SnowflakeConverter
-
unused
- CONFLUENT - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
- CONNECTOR_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- constructMetricName(String, String, String) - Static method in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Construct the actual metrics name that will be passed in by dropwizard framework to
MetricsJmxReporter.getObjectName(String, String, String)We will prefix actual metric name with partitionName and subcategory of the metric. - convertAppName(Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
-
modify invalid application name in config and return the generated application name
- convertConfigForStreamingClient(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- convertToJson(Schema, Object) - Static method in class com.snowflake.kafka.connector.records.RecordService
-
Convert this object, in the org.apache.kafka.connect.data format, into a JSON object, returning the converted object.
- createClient(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
-
Creates a streaming client from the given config
- createPipe(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
create a snowpipe if not exists
- createPipe(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createPipe(String, String, String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
create a snowpipe
- createPipe(String, String, String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createStage(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
create stage if not exists
- createStage(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createStage(String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
create a stage
- createStage(String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createTable(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
create table is not exists
- createTable(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createTable(String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Create a table with two variant columns: RECORD_METADATA and RECORD_CONTENT
- createTable(String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- createTableWithOnlyMetadataColumn(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Create a table with only the RECORD_METADATA column.
- createTableWithOnlyMetadataColumn(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- CUSTOM_SNOWFLAKE_CONVERTERS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
D
- databaseExists(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check if a given database exists
- databaseExists(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- debug(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
-
Logs an debug level message
- DEFAULT - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
- DEFAULT_REDIRECT_URI - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- defaultValue() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- determineIngestionMethod(Map<String, String>) - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
-
Returns the Ingestion Method found in User Configuration for Snowflake Kafka Connector.
- doc() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- dropPipe(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
drop snowpipe
- dropPipe(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- dropStage(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
drop stage
- dropStage(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- dropStageIfEmpty(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
drop stage if the given stage is empty
- dropStageIfEmpty(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- dummyPutCommandTemplateAWSAndAzure - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
- dummyPutCommandTemplateGCS - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
- dummyPutCommandToGetStageType - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
- dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
- dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
- dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
-
Adds the required fields into the given ObjectNode which will then be used as payload in Telemetry API
- dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- dumpTo(ObjectNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- DURATION_BETWEEN_GET_OFFSET_TOKEN_RETRY - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
E
- ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_CHANNEL_OFFSET_TOKEN_MIGRATION_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_MDC_LOGGING_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_MDC_LOGGING_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_MDC_LOGGING_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_MDC_LOGGING_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_SCHEMATIZATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_SCHEMATIZATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_STREAMING_CLIENT_OPTIMIZATION_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_STREAMING_CLIENT_OPTIMIZATION_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_STREAMING_CLIENT_OPTIMIZATION_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ENABLE_STREAMING_CLIENT_OPTIMIZATION_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- EncryptionUtils - Class in com.snowflake.kafka.connector.internal
- EncryptionUtils() - Constructor for class com.snowflake.kafka.connector.internal.EncryptionUtils
- END_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- ensureValid(String, Object) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
- ensureValid(String, Object) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
- ERR_TABLE_DOES_NOT_EXIST_NOT_AUTHORIZED - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- error(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
-
Logs an error level message
- ERROR_0001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0018 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0019 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0020 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0021 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0022 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0023 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0024 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0025 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0026 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0027 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0028 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_0029 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_1001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_1002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_1003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_1004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_2017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_3001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_3002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_3003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_3004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_3005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_4001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5001 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5002 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5003 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5004 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5005 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5006 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5007 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5008 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5009 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5010 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5011 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5012 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5013 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5014 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5015 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5016 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5017 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5018 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5019 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5020 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5021 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5022 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_5023 - com.snowflake.kafka.connector.internal.SnowflakeErrors
- ERROR_GROUP - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_DEAD_LETTER_QUEUE_TOPIC_NAME_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_LOG_ENABLE_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_LOG_ENABLE_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_LOG_ENABLE_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_LOG_ENABLE_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_TOLERANCE_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_TOLERANCE_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_TOLERANCE_DISPLAY - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- ERRORS_TOLERANCE_DOC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- evolveSchemaIfNeeded(SnowflakeConnectionService, String, List<String>, List<String>, SinkRecord) - Static method in class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
-
Execute a ALTER TABLE command if there is any extra column that needs to be added, or any column nullability that needs to be updated, used by schema evolution
F
- FETCH_OAUTH_TOKEN - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- fetchOffsetTokenWithRetry() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Fetches the offset token from Snowflake.
- field(String) - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- fields() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- FILE_COUNT_ON_INGESTION - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Number of files we call insertFiles API in snowpipe.
- FILE_COUNT_ON_INGESTION - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_ON_STAGE - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Number of files currently on an internal stage.
- FILE_COUNT_ON_STAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_PURGED - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Number of files purged from internal stage because we were able to verify the ingestion status
- FILE_COUNT_PURGED - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_REPROCESS_PURGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_RESTART - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- FILE_COUNT_TABLE_STAGE_BROKEN_RECORD - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Number of files present on table stage because files corresponds to broken offset (Broken record)
- FILE_COUNT_TABLE_STAGE_BROKEN_RECORD - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_TABLE_STAGE_INGEST_FAIL - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- FILE_COUNT_TABLE_STAGE_INGESTION_FAIL - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Number of files present on table stage due to failed ingestion (Missing Ingestion Status).
- fileName(String, String, int, long, long) - Static method in class com.snowflake.kafka.connector.internal.FileNameUtils
-
generate file name File Name Format: app/table/partition/start_end_timeStamp.fileFormat.gz Note: all file names should using the this format
- FileNameUtils - Class in com.snowflake.kafka.connector.internal
- FileNameUtils() - Constructor for class com.snowflake.kafka.connector.internal.FileNameUtils
- FLUSHED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Offset number(Record) that is being flushed into an internal stage after the buffer threshold was reached.
- FLUSHED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- formatLogMessage(String, Object...) - Static method in class com.snowflake.kafka.connector.Utils
-
the following method wraps log messages with Snowflake tag.
- formatName(String) - Static method in class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
-
Transform the objectName to uppercase unless it is enclosed in double quotes
- formatString(String, Object...) - Static method in class com.snowflake.kafka.connector.Utils
- fromConnectData(String, Schema, Object) - Method in class com.snowflake.kafka.connector.records.SnowflakeConverter
-
doesn't support data source connector
G
- generateChannelNameFormatV2(String, String) - Static method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
This is the new channel Name format that was created.
- generateProxyParametersIfRequired(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.InternalUtils
-
Helper method to decide whether to add any properties related to proxy server.
- generateValidName(String, Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
-
verify topic name, and generate valid table/application name
- GET_EXCEPTION_FORMAT - Static variable in class com.snowflake.kafka.connector.Utils
- GET_EXCEPTION_MISSING_CAUSE - Static variable in class com.snowflake.kafka.connector.Utils
- GET_EXCEPTION_MISSING_MESSAGE - Static variable in class com.snowflake.kafka.connector.Utils
- getApproxSizeOfRecordInBytes(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Get Approximate size of Sink Record which we get from Kafka.
- getBehaviorOnNullValuesConfig() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- getBehaviorOnNullValuesConfig() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getBrokenData() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
- getBufferSizeBytes() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- getChannel() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getChannelMigrateOffsetTokenResponseDTO(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- getChannelNameFormatV1() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getClient(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
-
Gets the current client or creates a new one from the given connector config.
- getCode() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getCode() - Method in exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
- getConnection() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
- getConnection() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- getConnectorName() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
- getConnectorName() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- getData() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
-
Return the data that was buffered because buffer threshold might have been reached
- getData() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
-
Get all rows and their offsets.
- getData() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
- getDefaultObjectNode(IngestionMethodConfig) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
This is the minimum JsonNode which will be present in each telemetry Payload.
- getDetail() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getDlqTopicName(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- getException() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getException(SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getException(Exception) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getException(Exception, SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getException(String) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- getException(String, SnowflakeTelemetryService) - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
-
Convert a given message into SnowflakeKafkaConnectorException.
- getExceptionMessage(String, Exception) - Static method in class com.snowflake.kafka.connector.Utils
-
Get the message and cause of a missing exception, handling the null or empty cases of each
- getFileSize() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- getFileSize() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
This is more of size in bytes of buffered records.
- getFirstOffset() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- getFlushTime() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- getFlushTime() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getFlushTimeThresholdSeconds() - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
- getIngestManager() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- getInternalStage() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- getLastOffset() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- getLatestConsumerOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
- getLatestConsumerOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getMessage() - Method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- getMessageByCode(Long) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- getMetricName() - Method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
- getMetricRegistry() - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
- getMetricRegistry(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- getMetricRegistry(String) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getMetricsJmxReporter() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
-
Gets the JMX metrics reporter
- getNumOfRecords() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- getObjectNode() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
- getObjectNode() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
Get default object Node which will be part of every telemetry being sent to snowflake.
- getObjectNode() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceV1
- getOffset(TopicPartition) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
retrieve offset of last loaded record for given pipe name
- getOffset(TopicPartition) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getOffsetPersistedInSnowflake() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
- getOffsetPersistedInSnowflake() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getOffsetSafeToCommitToKafka() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Get committed offset from Snowflake.
- getPartitionCount() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
get the number of partitions assigned to this sink service
- getPartitionCount() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getPreviousFlushTimeStampMs() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getProcessedOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
- getProcessedOffset() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getProcessedRecordForSnowpipe(SinkRecord) - Method in class com.snowflake.kafka.connector.records.RecordService
-
Given a single Record from put API, process it and convert it into a Json String.
- getProcessedRecordForStreamingIngest(SinkRecord) - Method in class com.snowflake.kafka.connector.records.RecordService
-
Given a single Record from put API, process it and convert it into Map of String and Object.
- getProperties() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- getRecordNumber() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- getRecordNumber() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getResponseCode() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
- getResponseMessage() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
- getScheme() - Method in class com.snowflake.kafka.connector.internal.SnowflakeURL
- getSinkRecord(long) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
- getSinkRecords() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
-
TODO:SNOW-552576 Avoid extra memory in buffer.
- getSinkRecords() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
- getSnowflakeConnection() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
Return an instance of SnowflakeConnection if it was set previously by calling Start().
- getSnowflakeOAuthAccessToken(SnowflakeURL, String, String, String) - Static method in class com.snowflake.kafka.connector.Utils
-
Get OAuth access token given refresh token
- getSnowflakeOAuthToken(SnowflakeURL, String, String, String, String, String, String) - Static method in class com.snowflake.kafka.connector.Utils
-
Get OAuth token given integration info Snowflake OAuth Overview
- getSnowflakeTelemetryChannelStatus() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getStageName() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
- getStageName() - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- getStageType(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
-
Get the backend stage type, S3, Azure or GCS.
- getStatusCode() - Method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- getStreamingBuffer() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getStreamingClientProviderForTests(SnowflakeStreamingIngestClient, StreamingClientHandler) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
-
ONLY FOR TESTING - to get a provider with injected properties
- getStreamingClientProviderInstance() - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientProvider
-
Gets the current streaming provider
- getStreamingIngestClient() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- getTelemetryClient() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
- getTelemetryClient() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- getTelemetryServiceV2() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- getTopicPartitionChannelFromCacheKey(String) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Used for testing Only
- GRANT_TYPE_PARAM - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
H
- hasSchemaEvolutionPermission(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Check whether the user has the role privilege to do schema evolution and whether the schema evolution option is enabled on the table
- hasSchemaEvolutionPermission(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
-
Check whether the user has the role privilege to do schema evolution and whether the schema evolution option is enabled on the table
- HTTP_NON_PROXY_HOSTS - Static variable in class com.snowflake.kafka.connector.Utils
- HTTP_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.Utils
- HTTP_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.Utils
- HTTP_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.Utils
- HTTP_PROXY_USER - Static variable in class com.snowflake.kafka.connector.Utils
- HTTP_USE_PROXY - Static variable in class com.snowflake.kafka.connector.Utils
- HTTPS_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.Utils
- HTTPS_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.Utils
- HTTPS_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.Utils
- HTTPS_PROXY_USER - Static variable in class com.snowflake.kafka.connector.Utils
I
- IGNORE - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
- incrementAndGetCleanerRestartCount() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- info(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
-
Logs an info level message
- ingestFile(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
Ingest single file
- ingestFile(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- ingestFiles(List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
Ingest a list of files
- ingestFiles(List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- INGESTION_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
-
Time difference between file being uploaded to internal stage to time knowing the successful file ingestion status through insertReport or loadHistoryScan API.
- INGESTION_METHOD_DEFAULT_SNOWPIPE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- INGESTION_METHOD_OPT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- IngestionMethodConfig - Enum in com.snowflake.kafka.connector.internal.streaming
-
Enum representing the allowed values for config
SnowflakeSinkConnectorConfig.INGESTION_METHOD_OPT - insert(Collection<SinkRecord>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
call pipe to insert a collections of JSON records will trigger time based flush
- insert(Collection<SinkRecord>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Inserts the given record into buffer and then eventually calls insertRows API if buffer threshold has reached.
- insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
-
Inserts the row into Buffer.
- insert(SinkRecord) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
call pipe to insert a JSON record will not trigger time based flush
- insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Inserts individual records into buffer.
- insert(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel.StreamingBuffer
- INSERT_FILES_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- INSERT_REPORT_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- insertBufferedRecordsIfFlushTimeThresholdReached() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
If difference between current time and previous flush time is more than threshold, insert the buffered Rows.
- insertRecordToBuffer(SinkRecord) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Inserts the record into buffer
- InternalUtils - Class in com.snowflake.kafka.connector.internal
- InternalUtils() - Constructor for class com.snowflake.kafka.connector.internal.InternalUtils
- InternalUtils.backoffFunction - Interface in com.snowflake.kafka.connector.internal
-
Interfaces to define the lambda function to be used by backoffAndRetry
- IS_CHANNEL_CLOSING - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
- IS_PIPE_CLOSING - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
- IS_REUSE_PIPE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- IS_REUSE_STAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- IS_REUSE_TABLE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- isBroken() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
- isChannelClosed() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- isChannelMigrationResponseSuccessful(ChannelMigrateOffsetTokenResponseDTO) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
-
Given a Response DTO, which was received from server side and serialized, check if it as successful migration or a failure.
- isClientValid(SnowflakeStreamingIngestClient) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
-
Checks if a given client is valid (not null, open and has a name)
- isClosed() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
- isClosed() - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- isClosed() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
retrieve sink service status
- isClosed() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- isEmpty() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- isOptional() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- isPartitionBufferEmpty() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- isPipeCompatible(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check snowpipe definition
- isPipeCompatible(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- isRecordContentValueNull() - Method in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
-
Check if primary reason for this record content's value to be an empty json String, a null value?
- isSingleFieldValid(Config) - Static method in class com.snowflake.kafka.connector.Utils
- isStageCompatible(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Examine all file names matches our pattern
- isStageCompatible(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- isTableCompatible(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Check the given table has correct schema correct schema: (record_metadata variant, record_content variant)
- isTableCompatible(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
J
- JAVA_IO_TMPDIR - Static variable in class com.snowflake.kafka.connector.Utils
- JDK_HTTP_AUTH_TUNNELING - Static variable in class com.snowflake.kafka.connector.Utils
- JMX_METRIC_PREFIX - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- JMX_OPT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JMX_OPT_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JVM_NON_PROXY_HOSTS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JVM_PROXY_HOST - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JVM_PROXY_PASSWORD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JVM_PROXY_PORT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- JVM_PROXY_USERNAME - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
K
- KAFKA_CHANNEL_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_CHANNEL_USAGE - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_FATAL_ERROR - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_LAG - com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
-
Time difference between the record put into kafka to record fetched into Kafka Connector Can be null if the value was not set inside a record.
- KAFKA_PIPE_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_PIPE_USAGE - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_START - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KAFKA_STOP - com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- KafkaProviderValidator() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
- KafkaRecordErrorReporter - Interface in com.snowflake.kafka.connector.dlq
-
This interface is a wrapper on top of
ErrantRecordReporter. - KCLogger - Class in com.snowflake.kafka.connector.internal
-
Logger for Snowflake Sink Connector.
- KCLogger(String) - Constructor for class com.snowflake.kafka.connector.internal.KCLogger
-
Create and return a new logging handler
- KEY_CONVERTER_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
-
Used to serialize the incoming records to kafka connector.
- keySchema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
L
- LATENCY_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- LATEST_CONSUMER_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- LATEST_CONSUMER_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- listStage(String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
list a non table stage and return a list of file names contained in given subdirectory
- listStage(String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- listStage(String, String, boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
list a stage and return a list of file names contained in given subdirectory
- listStage(String, String, boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- LOAD_HISTORY_SCAN_SNOWPIPE_API - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- logErrors(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- LOGGER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
- LOGGER - Static variable in class com.snowflake.kafka.connector.records.SnowflakeConverter
M
- MAX_GET_OFFSET_TOKEN_RETRIES - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- MAX_RECORD_OVERHEAD_BYTES - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- MDC_CONN_CTX_KEY - Static variable in class com.snowflake.kafka.connector.internal.KCLogger
- MEMORY_USAGE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- MetricsJmxReporter - Class in com.snowflake.kafka.connector.internal.metrics
-
Helper class for creation of JMX Metrics from metrics registry, also includes a definition to create an ObjectName used to register a
Metric - MetricsJmxReporter(MetricRegistry, String) - Constructor for class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
- MetricsUtil - Class in com.snowflake.kafka.connector.internal.metrics
-
All metrics related constants.
- MetricsUtil() - Constructor for class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- MetricsUtil.EventType - Enum in com.snowflake.kafka.connector.internal.metrics
- migrateStreamingChannelOffsetToken(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Migrate Streaming Channel offsetToken from a source Channel to a destination channel.
- migrateStreamingChannelOffsetToken(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- moveToTableStage(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
move all files on stage related to given pipe to table stage
- moveToTableStage(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- moveToTableStage(String, String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
- moveToTableStage(String, String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
N
- name() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- NAME - Static variable in class com.snowflake.kafka.connector.Utils
- names() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
- names() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
- NO_OFFSET_TOKEN_REGISTERED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- NON_AVRO_SCHEMA - Static variable in class com.snowflake.kafka.connector.records.SnowflakeRecordContent
- NONE - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
-
Tolerate no errors.
- NUM_METRICS - Static variable in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
O
- OAUTH - Static variable in class com.snowflake.kafka.connector.Utils
- OAUTH_CONTENT_TYPE_HEADER - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- OAuthConstants - Class in com.snowflake.kafka.connector.internal
-
This class contains constants for OAuth request.
- OAuthConstants() - Constructor for class com.snowflake.kafka.connector.internal.OAuthConstants
- of(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
- OFFSET_MIGRATION_SOURCE_AND_DESTINATION_CHANNEL_SAME - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- OFFSET_MIGRATION_SOURCE_CHANNEL_DOES_NOT_EXIST - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- OFFSET_PERSISTED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
See
TopicPartitionChannelfor offset description - OFFSET_PERSISTED_IN_SNOWFLAKE - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- OFFSET_SUB_DOMAIN - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
- open(Collection<TopicPartition>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
init ingestion task in Sink service
P
- parameters() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- parseEncryptedPrivateKey(String, String) - Static method in class com.snowflake.kafka.connector.internal.EncryptionUtils
- parseTopicToTableMap(String) - Static method in class com.snowflake.kafka.connector.Utils
- PartitionBuffer<T> - Class in com.snowflake.kafka.connector.internal
-
Abstract class which holds buffered data per partition including its start offset, end offset, size.
- PartitionBuffer() - Constructor for class com.snowflake.kafka.connector.internal.PartitionBuffer
-
Public constructor.
- partitionChannelKey(String, int) - Static method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Gets a unique identifier consisting of topic name and partition number.
- PIPE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- pipeExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check pipe existence
- pipeExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- pipeName(String, String, int) - Static method in class com.snowflake.kafka.connector.Utils
-
generate pipe name by given table and partition
- preCommit(Map<TopicPartition, OffsetAndMetadata>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
Sync committed offsets
- PRIVATE_KEY_PASSPHRASE - Static variable in class com.snowflake.kafka.connector.Utils
- PROCESSED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Offset number that is most recent inside the buffer (In memory buffer)
- PROCESSED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- PROVIDER_CONFIG - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- PROVIDER_NAMES - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
- PURGED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.metrics.MetricsUtil
-
Offsets which are being purged from internal stage.
- PURGED_OFFSET - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- purgeStage(String, List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
purge files from given stage
- purgeStage(String, List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- put(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
Deprecated.
- put(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
-
Deprecated.
- put(Collection<SinkRecord>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
ingest records to Snowflake
- putToTableStage(String, String, byte[]) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
put a file to table stage
- putToTableStage(String, String, byte[]) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- putWithCache(String, String, String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
put a file to stage.
- putWithCache(String, String, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- putWithCache(String, String, String, StageInfo.StageType) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
-
Upload file to internal stage with previously cached credentials.
Q
- quoteNameIfNeeded(String) - Static method in class com.snowflake.kafka.connector.Utils
-
Quote the column name if needed: When there is quote already, we do nothing; otherwise we convert the name to upper case and add quote
R
- READER_SCHEMA - Static variable in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
- readIngestReport(List<String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
retrieve status of given files from the ingest report
- readIngestReport(List<String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- readOneHourHistory(List<String>, long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
retrieve status of given files from load history in one hour time window
- readOneHourHistory(List<String>, long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- REBALANCING - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- REBALANCING_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- RECORD_NUMBER - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- RecordService - Class in com.snowflake.kafka.connector.records
- RecordService() - Constructor for class com.snowflake.kafka.connector.records.RecordService
-
Record service with null telemetry Service, only use it for testing.
- RecordService(SnowflakeTelemetryService) - Constructor for class com.snowflake.kafka.connector.records.RecordService
-
process records output JSON format: { "meta": { "offset": 123, "topic": "topic name", "partition": 123, "key":"key name" } "content": "record content" }
- REDIRECT_URI - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- refreshCredentials(String, StageInfo.StageType, String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
- REMOVE_FILE_FROM_INTERNAL_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- removeMetricsFromRegistry(String) - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
-
Unregister all snowflake KC related metrics from registry
- reportError(SinkRecord, Exception) - Method in interface com.snowflake.kafka.connector.dlq.KafkaRecordErrorReporter
- reportKafkaConnectFatalError(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
Event of a fatal error in the connector
- reportKafkaConnectStart(long, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
Event of connector start
- reportKafkaConnectStop(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
Event of connector stop
- reportKafkaPartitionStart(SnowflakeTelemetryBasicInfo) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
report connector partition start
- reportKafkaPartitionUsage(SnowflakeTelemetryBasicInfo, boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
report connector's partition usage.
- resetMemoryUsage() - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
S
- schema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- schemaExists(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check if a given schema exists
- schemaExists(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- SchematizationUtils - Class in com.snowflake.kafka.connector.internal.streaming
-
This is a class containing the helper functions related to schematization
- SchematizationUtils() - Constructor for class com.snowflake.kafka.connector.internal.streaming.SchematizationUtils
- SELF_HOSTED - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
- send(SnowflakeTelemetryService.TelemetryType, JsonNode) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
JsonNode data is wrapped into another ObjectNode which looks like this:
- setAndGetEnableSchematizationFromConfig(Map<String, String>) - Method in class com.snowflake.kafka.connector.records.RecordService
-
extract enableSchematization from the connector config and set the value for the recordService
- setAppName(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
set app name
- setAppName(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
- setAverageCommitLagFileCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setAverageCommitLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setAverageIngestionLagFileCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setAverageIngestionLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setAverageKafkaLagMs(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setAverageKafkaLagRecordCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setBehaviorOnNullValues(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.records.RecordService
-
Directly set the behaviorOnNullValues through param
- setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setBehaviorOnNullValuesConfig(SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setBufferSizeBytes(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- setCleanerRestartCount(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setCommittedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setConnectorName(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- setCustomJMXMetrics(boolean) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- setCustomJMXMetrics(boolean) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setCustomJMXMetrics(boolean) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setDefaultValues(Map<String, String>) - Static method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- setEnableSchematization(boolean) - Method in class com.snowflake.kafka.connector.records.RecordService
-
Directly set the enableSchematization through param
- setErrorReporter(KafkaRecordErrorReporter) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- setErrorReporter(KafkaRecordErrorReporter) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setErrorReporter(KafkaRecordErrorReporter) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setFileCountReprocessPurge(int) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setFileCountRestart(int) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setFileSize(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
change data size of buffer to control the flush rate, the minimum file size is controlled by
SnowflakeSinkConnectorConfig.BUFFER_SIZE_BYTES_MIN - setFileSize(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setFileSize(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Assume this is buffer size in bytes, since this is streaming ingestion
- setFirstOffset(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- setFlushedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setFlushTime(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
change flush rate of sink service the minimum flush time is controlled by
SnowflakeSinkConnectorConfig.BUFFER_FLUSH_TIME_SEC_MIN - setFlushTime(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setFlushTime(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setIsStoppedToTrue() - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
close all cleaner thread but have no effect on sink service context
- setIsStoppedToTrue() - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setJDBCLoggingDirectory() - Static method in class com.snowflake.kafka.connector.Utils
-
Read JDBC logging directory from environment variable JDBC_LOG_DIR and set that in System property
- setLastOffset(long) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- setLatestConsumerOffset(long) - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- setMetadataConfig(SnowflakeMetadataConfig) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
set the metadata config to let user control what metadata to be collected into SF db
- setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setMetadataConfig(SnowflakeMetadataConfig) - Method in class com.snowflake.kafka.connector.records.RecordService
- setNumOfRecords(int) - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- setProcessedOffset(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- setProperties(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- setProperties(Properties) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- setPurgedOffsetAtomically(LongUnaryOperator) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
Either keeps the same offset or updates the purgedOffset if a higher value offset is found in insertReport Snowpipe API
- setRecordNumber(long) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
change maximum number of record cached in buffer to control the flush rate, 0 for unlimited
- setRecordNumber(long) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setRecordNumber(long) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setReusePipe(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setReuseStage(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setReuseTable(boolean) - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
- setReuseTable(boolean) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setSinkTaskContext(SinkTaskContext) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
- setSinkTaskContext(SinkTaskContext) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
-
Set SinkTaskContext for the respective SnowflakeSinkService instance at runtime.
- setSinkTaskContext(SinkTaskContext) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setStartTime(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
-
set task id
- setTaskID(String) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
- setTelemetry(SnowflakeTelemetryService) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeIngestionService
-
Set telemetry client
- setTelemetry(SnowflakeTelemetryService) - Method in class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceV1
- setTopic2TableMap(Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
pass topic to table map to sink service
- setTopic2TableMap(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder
- setTopic2TableMap(Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- setURL(SnowflakeURL) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- SF_AUTHENTICATOR - Static variable in class com.snowflake.kafka.connector.Utils
- SF_DATABASE - Static variable in class com.snowflake.kafka.connector.Utils
- SF_OAUTH_CLIENT_ID - Static variable in class com.snowflake.kafka.connector.Utils
- SF_OAUTH_CLIENT_SECRET - Static variable in class com.snowflake.kafka.connector.Utils
- SF_OAUTH_REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.Utils
- SF_PRIVATE_KEY - Static variable in class com.snowflake.kafka.connector.Utils
- SF_ROLE - Static variable in class com.snowflake.kafka.connector.Utils
-
This value should be present if ingestion method is
IngestionMethodConfig.SNOWPIPE_STREAMING - SF_SCHEMA - Static variable in class com.snowflake.kafka.connector.Utils
- SF_SSL - Static variable in class com.snowflake.kafka.connector.Utils
- SF_URL - Static variable in class com.snowflake.kafka.connector.Utils
- SF_USER - Static variable in class com.snowflake.kafka.connector.Utils
- SF_WAREHOUSE - Static variable in class com.snowflake.kafka.connector.Utils
- shouldFlushOnBufferByteSize(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
-
Returns true the buffer should flush based on the current buffer byte size
- shouldFlushOnBufferRecordCount(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
-
Returns true the buffer should flush based on the current buffer record count
- shouldFlushOnBufferTime(long) - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
-
Returns true the buffer should flush based on the last flush time
- shouldSkipNullValue(SinkRecord, SnowflakeSinkConnectorConfig.BehaviorOnNullValues) - Method in class com.snowflake.kafka.connector.records.RecordService
-
Returns true if we want to skip this record since the value is null or it is an empty json string.
- SNOWFLAKE_JDBC_TRACE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_JWT - Static variable in class com.snowflake.kafka.connector.Utils
- SNOWFLAKE_METADATA_ALL - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_METADATA_CREATETIME - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_METADATA_DEFAULT - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_METADATA_OFFSET_AND_PARTITION - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_METADATA_TOPIC - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SNOWFLAKE_ROLE - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SnowflakeAvroConverter - Class in com.snowflake.kafka.connector.records
- SnowflakeAvroConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
- SnowflakeAvroConverterWithoutSchemaRegistry - Class in com.snowflake.kafka.connector.records
- SnowflakeAvroConverterWithoutSchemaRegistry() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeAvroConverterWithoutSchemaRegistry
- SnowflakeConnectionService - Interface in com.snowflake.kafka.connector.internal
- SnowflakeConnectionServiceBuilder() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder
- SnowflakeConnectionServiceFactory - Class in com.snowflake.kafka.connector.internal
- SnowflakeConnectionServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceFactory
- SnowflakeConnectionServiceFactory.SnowflakeConnectionServiceBuilder - Class in com.snowflake.kafka.connector.internal
- SnowflakeConnectionServiceV1 - Class in com.snowflake.kafka.connector.internal
-
Implementation of Snowflake Connection Service interface which includes all handshake between KC and SF through JDBC connection.
- SnowflakeConverter - Class in com.snowflake.kafka.connector.records
-
Snowflake Converter
- SnowflakeConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeConverter
- SnowflakeErrors - Enum in com.snowflake.kafka.connector.internal
- SnowflakeIngestionService - Interface in com.snowflake.kafka.connector.internal
-
Ingestion service manages snow pipe
- SnowflakeIngestionServiceFactory - Class in com.snowflake.kafka.connector.internal
-
A factory to create
SnowflakeIngestionService - SnowflakeIngestionServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeIngestionServiceFactory
- SnowflakeIngestionServiceV1 - Class in com.snowflake.kafka.connector.internal
-
Implementation of Snowpipe API calls.
- SnowflakeInternalOperations - Enum in com.snowflake.kafka.connector.internal
-
Enum placeholders for internal operations.
- SnowflakeInternalStage - Class in com.snowflake.kafka.connector.internal
-
Implementation of put API through JDBC's API uploadWithoutConnection.
- SnowflakeInternalStage(SnowflakeConnectionV1, long, Properties) - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeInternalStage
- SnowflakeJsonConverter - Class in com.snowflake.kafka.connector.records
- SnowflakeJsonConverter() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeJsonConverter
- SnowflakeJsonSchema - Class in com.snowflake.kafka.connector.records
-
Snowflake json schema
- SnowflakeJsonSchema() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- SnowflakeKafkaConnectorException - Exception in com.snowflake.kafka.connector.internal
- SnowflakeKafkaConnectorException(String, String) - Constructor for exception com.snowflake.kafka.connector.internal.SnowflakeKafkaConnectorException
- SnowflakeMetadataConfig - Class in com.snowflake.kafka.connector.records
- SnowflakeMetadataConfig() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
-
initialize with default config
- SnowflakeMetadataConfig(Map<String, String>) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
-
set flag to false only if metadata config is set to false in config
- SnowflakeRecordContent - Class in com.snowflake.kafka.connector.records
- SnowflakeRecordContent() - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
-
Constructor for null value.
- SnowflakeRecordContent(byte[]) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
-
constructor for broken record
- SnowflakeRecordContent(JsonNode) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
-
constructor for json converter
- SnowflakeRecordContent(Schema, Object) - Constructor for class com.snowflake.kafka.connector.records.SnowflakeRecordContent
-
constructor for native json converter
- SnowflakeSinkConnector - Class in com.snowflake.kafka.connector
-
SnowflakeSinkConnector implements SinkConnector for Kafka Connect framework.
- SnowflakeSinkConnector() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnector
-
No-Arg constructor.
- SnowflakeSinkConnectorConfig - Class in com.snowflake.kafka.connector
-
SnowflakeSinkConnectorConfig class is used for specifying the set of expected configurations.
- SnowflakeSinkConnectorConfig() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- SnowflakeSinkConnectorConfig.BehaviorOnNullValues - Enum in com.snowflake.kafka.connector
- SnowflakeSinkConnectorConfig.ErrorTolerance - Enum in com.snowflake.kafka.connector
- SnowflakeSinkConnectorConfig.KafkaProvider - Enum in com.snowflake.kafka.connector
- SnowflakeSinkConnectorConfig.KafkaProviderValidator - Class in com.snowflake.kafka.connector
- SnowflakeSinkConnectorConfig.TopicToTableValidator - Class in com.snowflake.kafka.connector
- SnowflakeSinkService - Interface in com.snowflake.kafka.connector.internal
-
Background service of data sink, responsible to create/drop pipe and ingest/purge files
- SnowflakeSinkServiceFactory - Class in com.snowflake.kafka.connector.internal
-
A factory to create
SnowflakeSinkService - SnowflakeSinkServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeSinkServiceFactory
- SnowflakeSinkServiceFactory.SnowflakeSinkServiceBuilder - Class in com.snowflake.kafka.connector.internal
-
Builder class to create instance of
SnowflakeSinkService - SnowflakeSinkServiceV2 - Class in com.snowflake.kafka.connector.internal.streaming
-
This is per task configuration.
- SnowflakeSinkServiceV2(long, long, long, SnowflakeConnectionService, RecordService, SnowflakeTelemetryService, Map<String, String>, SnowflakeSinkConnectorConfig.BehaviorOnNullValues, boolean, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeStreamingIngestClient, Map<String, String>, boolean, Map<String, TopicPartitionChannel>) - Constructor for class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- SnowflakeSinkServiceV2(SnowflakeConnectionService, Map<String, String>) - Constructor for class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
- SnowflakeSinkTask - Class in com.snowflake.kafka.connector
-
SnowflakeSinkTask implements SinkTask for Kafka Connect framework.
- SnowflakeSinkTask() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
-
default constructor, invoked by kafka connect framework
- SnowflakeSinkTask(SnowflakeSinkService, SnowflakeConnectionService) - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
- SnowflakeSinkTask(SnowflakeSinkService, SnowflakeConnectionService, Map<String, String>) - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkTask
- SnowflakeTelemetryBasicInfo - Class in com.snowflake.kafka.connector.internal.telemetry
-
Minimum information needed to sent to Snowflake through Telemetry API
- SnowflakeTelemetryBasicInfo(String, SnowflakeTelemetryService.TelemetryType) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
-
Base Constructor.
- SnowflakeTelemetryChannelCreation - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
-
This object is sent only once when a channel starts.
- SnowflakeTelemetryChannelCreation(String, String, long) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelCreation
- SnowflakeTelemetryChannelStatus - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
-
Extension of
SnowflakeTelemetryBasicInfoclass used to send data to snowflake when the TopicPartitionChannel closes. - SnowflakeTelemetryChannelStatus(String, String, String, long, boolean, MetricsJmxReporter, AtomicLong, AtomicLong, AtomicLong) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
-
Creates a new object tracking
TopicPartitionChannelmetrics with JMX and send telemetry data to snowflake - SnowflakeTelemetryPipeCreation - Class in com.snowflake.kafka.connector.internal.telemetry
-
This object is send only once when pipe starts No concurrent modification is made on this object, thus no lock is required.
- SnowflakeTelemetryPipeCreation(String, String, String) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeCreation
- SnowflakeTelemetryPipeStatus - Class in com.snowflake.kafka.connector.internal.telemetry
-
Extension of
SnowflakeTelemetryBasicInfoclass used to send data to snowflake periodically. - SnowflakeTelemetryPipeStatus(String, String, String, boolean, MetricsJmxReporter) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
- SnowflakeTelemetryService - Class in com.snowflake.kafka.connector.internal.telemetry
-
Abstract class handling basics of sending telemetry information to snowflake.
- SnowflakeTelemetryService() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
- SnowflakeTelemetryService.TelemetryType - Enum in com.snowflake.kafka.connector.internal.telemetry
- SnowflakeTelemetryServiceBuilder(Connection, IngestionMethodConfig) - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder
- SnowflakeTelemetryServiceFactory - Class in com.snowflake.kafka.connector.internal.telemetry
-
Factory class which produces the telemetry service which essentially has a telemetry client instance.
- SnowflakeTelemetryServiceFactory() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryServiceFactory
- SnowflakeTelemetryServiceFactory.SnowflakeTelemetryServiceBuilder - Class in com.snowflake.kafka.connector.internal.telemetry
-
Builder for TelemetryService
- SnowflakeTelemetryServiceV1 - Class in com.snowflake.kafka.connector.internal.telemetry
-
Implementation of Snowflake Telemetry Service specific for Snowpipe telemetries.
- SnowflakeTelemetryServiceV2 - Class in com.snowflake.kafka.connector.internal.streaming.telemetry
-
This is the implementation of Telemetry Service for Snowpipe Streaming.
- SnowflakeTelemetryServiceV2(Connection) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
-
Constructor for TelemetryService which is used by Snowpipe Streaming.
- SnowflakeTelemetryServiceV2(Telemetry) - Constructor for class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryServiceV2
- SnowflakeURL - Class in com.snowflake.kafka.connector.internal
-
Snowflake URL Object https://account.region.snowflakecomputing.com:443
- SnowflakeURL(String) - Constructor for class com.snowflake.kafka.connector.internal.SnowflakeURL
- SNOWPIPE - com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
- SNOWPIPE_STREAMING - com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
- SNOWPIPE_STREAMING_FILE_VERSION - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- STAGE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- stageExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check stage existence
- stageExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- stageName(String, String) - Static method in class com.snowflake.kafka.connector.Utils
-
generate stage name by given table
- start() - Method in class com.snowflake.kafka.connector.internal.metrics.MetricsJmxReporter
-
This function will internally register all metrics present inside metric registry and will register mbeans to the mbeanserver
- start(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
-
start method will only be called on a clean connector, i.e.
- start(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
start method handles configuration parsing and one-time setup of the task.
- START_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- startPartition(String, TopicPartition) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
Start the Task.
- startPartition(String, TopicPartition) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Creates a table if it doesnt exist in Snowflake.
- startPartitions(Collection<TopicPartition>, Map<String, String>) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeSinkService
-
Start a collection of TopicPartition.
- startPartitions(Collection<TopicPartition>, Map<String, String>) - Method in class com.snowflake.kafka.connector.internal.streaming.SnowflakeSinkServiceV2
-
Initializes multiple Channels and partitionsToChannel maps with new instances of
TopicPartitionChannel - stop() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
-
Stop method will be called to stop a connector, cleans up snowflake internal stages, after making sure that there are no pending files to ingest.
- stop() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
-
stop method is invoked only once outstanding calls to other methods have completed.
- STREAMING_BUFFER_BYTES_DEFAULT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
-
Keeping this default as ~ 20MB.
- STREAMING_BUFFER_COUNT_RECORDS_DEFAULT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_BUFFER_FLUSH_TIME_DEFAULT_SEC - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_BUFFER_FLUSH_TIME_MINIMUM_SEC - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_AUTHORIZATION_TYPE - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_JWT - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_OAUTH - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_OAUTH_CLIENT_ID - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_OAUTH_CLIENT_SECRET - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- STREAMING_CONSTANT_OAUTH_REFRESH_TOKEN - Static variable in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- StreamingBufferThreshold - Class in com.snowflake.kafka.connector.internal.streaming
-
Helper class Associated to Streaming Snowpipe runtime of Kafka Connect which can help to identify if there is a need to flush the buffered records.
- StreamingBufferThreshold(long, long, long) - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingBufferThreshold
- StreamingClientHandler - Class in com.snowflake.kafka.connector.internal.streaming
-
This class handles all calls to manage the streaming ingestion client
- StreamingClientHandler() - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingClientHandler
- StreamingClientProvider - Class in com.snowflake.kafka.connector.internal.streaming
-
Factory that provides the streaming client(s).
- StreamingUtils - Class in com.snowflake.kafka.connector.internal.streaming
- StreamingUtils() - Constructor for class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- SUCCESS - com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
T
- TABLE_COLUMN_CONTENT - Static variable in class com.snowflake.kafka.connector.Utils
- TABLE_COLUMN_METADATA - Static variable in class com.snowflake.kafka.connector.Utils
- TABLE_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- tableExist(String) - Method in interface com.snowflake.kafka.connector.internal.SnowflakeConnectionService
-
check table existence
- tableExist(String) - Method in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- tableName - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
- tableName(String, Map<String, String>) - Static method in class com.snowflake.kafka.connector.Utils
-
verify topic name, and generate valid table name
- TASK_ID - Static variable in class com.snowflake.kafka.connector.Utils
- taskClass() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
- taskConfigs(int) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
-
taskConfigs method returns a set of configurations for SinkTasks based on the current configuration, producing at most 'maxTasks' configurations
- telemetry - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService
- TelemetryConstants - Class in com.snowflake.kafka.connector.internal.telemetry
-
Placeholder for all constants used for Sending information from Connector to Snowflake through Telemetry API
- TelemetryConstants() - Constructor for class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- telemetryType - Variable in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryBasicInfo
- TIME_FORMAT - Static variable in class com.snowflake.kafka.connector.records.RecordService
- toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverter
-
cast bytes array to JsonNode array
- toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeAvroConverterWithoutSchemaRegistry
-
Parse Avro record without schema
- toConnectData(String, byte[]) - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonConverter
-
cast bytes array to Json array
- toggleGlobalMdcLoggingContext(boolean) - Static method in class com.snowflake.kafka.connector.internal.KCLogger
-
Enable or disables the MDC context.
- TOKEN_REQUEST_ENDPOINT - Static variable in class com.snowflake.kafka.connector.internal.OAuthConstants
- tolerateErrors(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
- TOPIC_PARTITION_CHANNEL_CLOSE_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- TOPIC_PARTITION_CHANNEL_CREATION_TIME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- TOPIC_PARTITION_CHANNEL_NAME - Static variable in class com.snowflake.kafka.connector.internal.telemetry.TelemetryConstants
- TopicPartitionChannel - Class in com.snowflake.kafka.connector.internal.streaming
-
This is a wrapper on top of Streaming Ingest Channel which is responsible for ingesting rows to Snowflake.
- TopicPartitionChannel(SnowflakeStreamingIngestClient, TopicPartition, String, String, boolean, BufferThreshold, Map<String, String>, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeConnectionService, RecordService, SnowflakeTelemetryService, boolean, MetricsJmxReporter) - Constructor for class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- TopicPartitionChannel(SnowflakeStreamingIngestClient, TopicPartition, String, String, BufferThreshold, Map<String, String>, KafkaRecordErrorReporter, SinkTaskContext, SnowflakeConnectionService, SnowflakeTelemetryService) - Constructor for class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
-
Testing only, initialize TopicPartitionChannel without the connection service
- TopicPartitionChannel.StreamingBuffer - Class in com.snowflake.kafka.connector.internal.streaming
-
A buffer which holds the rows before calling insertRows API.
- TopicPartitionChannelInsertionException - Exception in com.snowflake.kafka.connector.internal.streaming
-
Class for exceptions that occur while interacting with Snowflake through Snowpipe Streaming.
- TopicPartitionChannelInsertionException(String, Throwable) - Constructor for exception com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannelInsertionException
- TOPICS - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- TopicToTableValidator() - Constructor for class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
- toString() - Method in class com.snowflake.kafka.connector.internal.BufferThreshold
- toString() - Method in class com.snowflake.kafka.connector.internal.PartitionBuffer
- toString() - Method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
- toString() - Method in class com.snowflake.kafka.connector.internal.SnowflakeURL
- toString() - Method in class com.snowflake.kafka.connector.internal.streaming.ChannelMigrateOffsetTokenResponseDTO
- toString() - Method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
- toString() - Method in class com.snowflake.kafka.connector.internal.streaming.TopicPartitionChannel
- toString() - Method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
- toString() - Method in class com.snowflake.kafka.connector.records.SnowflakeMetadataConfig
- toString() - Method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
- toString() - Method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
- toString() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProviderValidator
- toString() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.TopicToTableValidator
- trace(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
-
Logs an trace level message
- tryUnregisterChannelJMXMetrics() - Method in class com.snowflake.kafka.connector.internal.streaming.telemetry.SnowflakeTelemetryChannelStatus
-
Unregisters the JMX metrics if possible
- type() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
U
- UNKNOWN - com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
- UNKNOWN_STATUS_MESSAGE - Static variable in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
- updateBrokenRecordMetrics(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
When either key or value is broken.
- updateCommitLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
Commit Lag is time between kafka connector commits the after calling insertFiles API and time file was flushed into internal stage.
- updateConfigErrorMessage(Config, String, String) - Static method in class com.snowflake.kafka.connector.Utils
- updateFailedIngestionMetrics(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
When Ingestion status of n number of files is not found/failed.
- updateIngestionLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
Ingestion Lag is time between kafka connector flushes the file and time file was first found from insertReport/loadHistory API.
- updateKafkaLag(long) - Method in class com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryPipeStatus
-
Kafka Lag is time between kafka connector sees the record and time record was inserted into kafka.
- UPLOAD_FILE_TO_INTERNAL_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- UPLOAD_FILE_TO_INTERNAL_STAGE_NO_CONNECTION - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- UPLOAD_FILE_TO_TABLE_STAGE - com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
- USER_AGENT_SUFFIX_FORMAT - Static variable in class com.snowflake.kafka.connector.internal.SnowflakeConnectionServiceV1
- Utils - Class in com.snowflake.kafka.connector
-
Various arbitrary helper functions
- Utils() - Constructor for class com.snowflake.kafka.connector.Utils
V
- validate(Map<String, String>) - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
- validateBufferThreshold(Map<String, String>, IngestionMethodConfig) - Static method in class com.snowflake.kafka.connector.internal.BufferThreshold
-
Check if provided snowflake kafka connector buffer properties are within permissible values.
- validateConfigToMap(Config) - Static method in class com.snowflake.kafka.connector.Utils
- validateStreamingSnowpipeConfig(Map<String, String>) - Static method in class com.snowflake.kafka.connector.internal.streaming.StreamingUtils
-
Validate Streaming snowpipe related config provided by config(customer's config)
- VALIDATOR - Static variable in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
- VALIDATOR - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
- VALIDATOR - Static variable in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
-
Validator to validate behavior.on.null.values which says whether kafka should keep null value records or ignore them while ingesting into snowflake table.
- VALUE_CONVERTER_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- VALUE_SCHEMA_REGISTRY_CONFIG_FIELD - Static variable in class com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum com.snowflake.kafka.connector.internal.metrics.MetricsUtil.EventType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeErrors
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.internal.SnowflakeInternalOperations
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.internal.streaming.ChannelMigrationResponseCode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.internal.streaming.IngestionMethodConfig
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.internal.telemetry.SnowflakeTelemetryService.TelemetryType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.BehaviorOnNullValues
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.ErrorTolerance
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.snowflake.kafka.connector.SnowflakeSinkConnectorConfig.KafkaProvider
-
Returns an array containing the constants of this enum type, in the order they are declared.
- valueSchema() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- version() - Method in class com.snowflake.kafka.connector.records.SnowflakeJsonSchema
- version() - Method in class com.snowflake.kafka.connector.SnowflakeSinkConnector
- version() - Method in class com.snowflake.kafka.connector.SnowflakeSinkTask
- VERSION - Static variable in class com.snowflake.kafka.connector.Utils
W
- warn(String, Object...) - Method in class com.snowflake.kafka.connector.internal.KCLogger
-
Logs an warn level message
All Classes All Packages