Goal: During development on Kafka streamings, we like to set up single node Kafka broker
Git clone the repo
$ git clone git@github.com:abulbasar/docker-examples.git
$ cd docker-example/kafka-single-node
Build the local docker image and run it using docker-compose. Do not close this terminal. If you want to run the container in background, append -d argument in the docker-compose up command.
$ docker-compose build && docker-compose up
Verify that the container is running
$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
461557deac68 kafka-single-node_broker "bash /start-service…" 8 minutes ago Up 19 seconds 0.0.0.0:2181->2181/tcp, 0.0.0.0:9092->9092/tcp kafka-single-node_broker_1
Launch a new terminal with console consumer. With topic auto creation turned on by default, the topic named sample will be created by default.
$ $ docker exec -it kafka-single-node_broker_1 kafka-console-producer.sh --broker-list kafka:9092 --topic sample
Launch another terminal with producer
$ $ docker exec -it kafka-single-node_broker_1 kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic sample --from-beginning
Note: bootstrap server is the name of the hostname set in the docker-compose.yml file.
Type in a few message in the producer and see those message appear in the console consumer end.