Start the Kafka and Zookeeper containers
docker-compose up -dSSH into the Kafka container
docker exec -it kafka /bin/shCreate a orders topic
$KAFKA_HOME/bin/kafka-topics.sh --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1Write messages to the topic
$KAFKA_HOME/bin/kafka-console-producer.sh --topic=orders --broker-list localhost:9092Consume messages sent by the producer from beginning
$KAFKA_HOME/bin/kafka-console-consumer.sh --topic=orders --from-beginning --bootstrap-server localhost:9092Create a locations topic
$KAFKA_HOME/bin/kafka-topics.sh --create --topic locations --bootstrap-server localhost:9092 --partitions 3 --replication-factor 1Write messages to the topic
$KAFKA_HOME/bin/kafka-console-producer.sh --topic locations --broker-list localhost:9092Consume messages within a consumer group
$KAFKA_HOME/bin/kafka-console-consumer.sh --topic locations --group group-ABC --bootstrap-server localhost:9092Retrieve the list of topics
$KAFKA_HOME/bin/kafka-topics.sh --list --bootstrap-server localhost:9092Describe the orders topic
$KAFKA_HOME/bin/kafka-topics.sh --describe --topic orders --bootstrap-server localhost:9092Retrieve the list of consumer groups
$KAFKA_HOME/bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --list$KAFKA_HOME/bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --all-groupsReset offsets
$KAFKA_HOME/bin/kafka-consumer-groups.sh --reset-offsets --to-offset 0 --bootstrap-server localhost:9092 --execute --group group-ABC --topic locationsReset offset of a specific topic:partition
$KAFKA_HOME/bin/kafka-consumer-groups.sh --reset-offsets --to-offset 1 --bootstrap-server localhost:9092 --execute --group group-ABC --topic locations:2Shift offset by 'n', where 'n' can be positive or negative
$KAFKA_HOME/bin/kafka-consumer-groups.sh --reset-offsets --shift-by -2 --bootstrap-server localhost:9092 --execute --group group-ABC --topic locations$KAFKA_HOME/bin/kafka-consumer-groups.sh --versionStop the containers
docker-compose downhttps://www.kafkatool.com/download.html
Configure the Properties tab with
- Cluster name
- Kafka cluster version (see here)
- Zookeeper Host (localhost)
- Zookeeper Port (2181)