KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.addRecordTimestamp(String addRecordTimestamp) |
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp"
that indicates the time when the corresponding record received by the topic.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.assign(String assign) |
The specific TopicPartitions to consume.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.bootstrapServers(String bootstrapServers) |
A list of bootstrap server URLs, for example, as
b-1.vpc-test-2.o4q88o.c6.kafka.us-east-1.amazonaws.com:9094.
|
static KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.builder() |
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.classification(String classification) |
An optional classification.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.connectionName(String connectionName) |
The name of the connection.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.delimiter(String delimiter) |
Specifies the delimiter character.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.emitConsumerLagMetrics(String emitConsumerLagMetrics) |
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the
oldest record received by the topic and the time it arrives in Glue to CloudWatch.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.endingOffsets(String endingOffsets) |
The end point when a batch query is ended.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.includeHeaders(Boolean includeHeaders) |
Whether to include the Kafka headers.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.maxOffsetsPerTrigger(Long maxOffsetsPerTrigger) |
The rate limit on the maximum number of offsets that are processed per trigger interval.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.minPartitions(Integer minPartitions) |
The desired minimum number of partitions to read from Kafka.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.numRetries(Integer numRetries) |
The number of times to retry before failing to fetch Kafka offsets.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.pollTimeoutMs(Long pollTimeoutMs) |
The timeout in milliseconds to poll data from Kafka in Spark job executors.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.retryIntervalMs(Long retryIntervalMs) |
The time in milliseconds to wait before retrying to fetch Kafka offsets.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.securityProtocol(String securityProtocol) |
The protocol used to communicate with brokers.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.startingOffsets(String startingOffsets) |
The starting position in the Kafka topic to read data from.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.startingTimestamp(Instant startingTimestamp) |
The timestamp of the record in the Kafka topic to start reading data from.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.subscribePattern(String subscribePattern) |
A Java regex string that identifies the topic list to subscribe to.
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.toBuilder() |
|
KafkaStreamingSourceOptions.Builder |
KafkaStreamingSourceOptions.Builder.topicName(String topicName) |
The topic name as specified in Apache Kafka.
|