Tutorial Docker Compose Kafka dengan UI Manager (Redpanda Console)

Kali ini saya akan berbagi sedikit tutorial Docker Compose Kafka dengan UI Manager (Redpanda Console). Semoga membantu teman-teman yang ingin melakukan setup kafka secara mudah dan cepat untuk server development.

Langkah-langkah Setup Kafka Broker + UI Manager (Redpanda Console) dengan Docker Compose

1. Buat folder untuk menyimpan file yang berhubungan dengan kafka

mkdir kafka/
cd kafka/

2. Buat file Docker Compose

vi docker-compose.yaml

services:
zoo1:
image: confluentinc/cp-zookeeper:7.3.2
hostname: zoo1
container_name: zoo1
ports:
- "2181:2181"
environment:
ZOOKEEPER_CLIENT_PORT: 2181
ZOOKEEPER_SERVER_ID: 1
ZOOKEEPER_SERVERS: zoo1:2888:3888
kafka1:
image: confluentinc/cp-kafka:7.3.2
hostname: kafka1
container_name: kafka1
ports:
- "9092:9092"
- "29092:29092"
- "9999:9999"
environment:
KAFKA_ADVERTISED_LISTENERS: INTERNAL://kafka1:19092,EXTERNAL://172.18.0.1:9092,DOCKER://host.docker.internal:29092
KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: INTERNAL:PLAINTEXT,EXTERNAL:PLAINTEXT,DOCKER:PLAINTEXT,EXTERNAL_PUBLIC:PLAINTEXT
KAFKA_INTER_BROKER_LISTENER_NAME: INTERNAL
KAFKA_ZOOKEEPER_CONNECT: "zoo1:2181"
KAFKA_BROKER_ID: 1
KAFKA_LOG4J_LOGGERS: "kafka.controller=INFO,kafka.producer.async.DefaultEventHandler=INFO,state.change.logger=INFO"
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1
KAFKA_JMX_PORT: 9999
KAFKA_JMX_HOSTNAME: ${DOCKER_HOST_IP:-127.0.0.1}
KAFKA_AUTHORIZER_CLASS_NAME: kafka.security.authorizer.AclAuthorizer
KAFKA_ALLOW_EVERYONE_IF_NO_ACL_FOUND: "true"
depends_on:
- zoo1
console:
image: docker.redpanda.com/redpandadata/console:v2.7.2
entrypoint: /bin/sh
command: -c "echo \"$$CONSOLE_CONFIG_FILE\" > /tmp/config.yml; /app/console"
environment:
CONFIG_FILEPATH: /tmp/config.yml
CONSOLE_CONFIG_FILE: |
kafka:
brokers: ["172.18.0.1:9092"]
ports:
- "8080:8080"

Note:

• Ganti address pada bagian berikut: EXTERNAL://172.18.0.1:9092 dan brokers: ["172.18.0.1:9092"]

Simpan

3. Jalankan Docker Compose

docker-compose up -d

Verifikasi

Tips:

• Amankan port web-ui, kafka-broker, zookeeper dari publik. Izinkan hanya IP Address tertentu.