What is meant by partition offset in Apache Kafka?

Pragya Keshap answered on February 6, 2023 Popularity 1/10 Helpfulness 1/10

answer What is meant by partition offset in Apache Kafka?

What is meant by partition offset in Apache Kafka?

Comment

Every time message or record is assigned to a partition in Kafka, it is provided with an offset.

The offset denotes the position of the record in that partition.

A record can be uniquely identified within a partition using the offset value.

The partition offset only carries meaning within that particular partition. Records are always added to the ends of partitions, and therefore, older records will have a lower offset.

public class ManualConsumer {

    public static void main(String[] args) throws Exception {

        String topicName = "SupplierTopic";
        String groupName = "SupplierTopicGroup";

        Properties props = new Properties();
        props.put("bootstrap.servers", "localhost:9092,localhost:9093");
        props.put("group.id", groupName);
        props.put("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
        props.put("value.deserializer", "SupplierDeserializer");
        props.put("enable.auto.commit", "false");

        KafkaConsumer<String, Supplier> consumer = null;

        try {
            consumer = new KafkaConsumer<>(props);
            consumer.subscribe(Arrays.asList(topicName));

            while (true) {
                ConsumerRecords<String, Supplier> records = consumer.poll(100);
                for (ConsumerRecord<String, Supplier> record : records) {
                    System.out.println("Supplier id= " + String.valueOf(record.value().getID()) +
                            " Supplier  Name = " + record.value().getName() +
                            " Supplier Start Date = " + record.value().getStartDate().toString());
                }
                consumer.commitAsync();
            }
        } catch (Exception ex) {
            ex.printStackTrace();
        } finally {
            consumer.commitSync();
            consumer.close();
        }
    }
}

https://www.learningjournal.guru/courses/kafka/kafka-foundation-training/offset-management/

Popularity 1/10 Helpfulness 1/10 Language java

Source: Grepper

Tags: java offset partition

Link to this answer
Share Copy Link

Contributed on Feb 06 2023

Pragya Keshap

0 Answers Avg Quality 2/10

What is meant by partition offset in Apache Kafka?

Contents

More Related Answers

What is meant by partition offset in Apache Kafka?

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.