Class KafkaCheckpointMark

  • All Implemented Interfaces:
    org.apache.beam.sdk.io.UnboundedSource.CheckpointMark

    @DefaultCoder(org.apache.beam.sdk.extensions.avro.coders.AvroCoder.class)
    public class KafkaCheckpointMark
    extends java.lang.Object
    implements org.apache.beam.sdk.io.UnboundedSource.CheckpointMark
    Checkpoint for a KafkaUnboundedReader. Consists of Kafka topic name, partition id, and the latest offset consumed so far.
    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      static class  KafkaCheckpointMark.PartitionMark
      A tuple to hold topic, partition, and offset that comprise the checkpoint for a single partition.
      • Nested classes/interfaces inherited from interface org.apache.beam.sdk.io.UnboundedSource.CheckpointMark

        org.apache.beam.sdk.io.UnboundedSource.CheckpointMark.NoopCheckpointMark
    • Field Summary

      • Fields inherited from interface org.apache.beam.sdk.io.UnboundedSource.CheckpointMark

        NOOP_CHECKPOINT_MARK
    • Constructor Detail

      • KafkaCheckpointMark

        public KafkaCheckpointMark​(java.util.List<KafkaCheckpointMark.PartitionMark> partitions,
                                   java.util.Optional<org.apache.beam.sdk.io.kafka.KafkaUnboundedReader<?,​?>> reader)
    • Method Detail

      • finalizeCheckpoint

        public void finalizeCheckpoint()
        Specified by:
        finalizeCheckpoint in interface org.apache.beam.sdk.io.UnboundedSource.CheckpointMark
      • toString

        public java.lang.String toString()
        Overrides:
        toString in class java.lang.Object