org.apache.hudi.utilities.sources.helpers

Class KafkaOffsetGen

java.lang.Object

org.apache.hudi.utilities.sources.helpers.KafkaOffsetGen

public class KafkaOffsetGen
extends Object

Source to read data from Kafka, incrementally

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	KafkaOffsetGen.CheckpointUtils

Field Summary

Fields

Modifier and Type	Field and Description
protected String	topicName

Constructor Summary

Constructors

Constructor and Description
KafkaOffsetGen(TypedProperties props)

Method Summary

Modifier and Type	Method and Description
HashMap<String,String>	getKafkaParams()
org.apache.spark.streaming.kafka.OffsetRange[]	getNextOffsetRanges(Option<String> lastCheckpointStr, long sourceLimit)
String	getTopicName()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

topicName

protected final String topicName

Constructor Detail

KafkaOffsetGen

public KafkaOffsetGen(TypedProperties props)

Method Detail

getNextOffsetRanges

public org.apache.spark.streaming.kafka.OffsetRange[] getNextOffsetRanges(Option<String> lastCheckpointStr,
                                                                          long sourceLimit)

getTopicName

public String getTopicName()

getKafkaParams

public HashMap<String,String> getKafkaParams()