Category : apache-kafka

I’m running locally on my windows Docker Desktop with linux containers. I created a zookeeper container using the following command : docker run -d –network kafka –name=MyZookeeper -p 2181:2181 -e ALLOW_ANONYMOUS_LOGIN=yes -e ZOOKEEPER_CLIENT_PORT=2181 confluentinc/cp-zookeeper:5.5.0 And a Kafka containier using this command : docker run -d –network kafka –name=MyKafka -p 9092:9092 -e ALLOW_PLAINTEXT_LISTENER=yes -e KAFKA_ZOOKEEPER_CONNECT=MyZookeeper:2181 -e ..

Read more

when I run kafka and zookeeper servers by hand everything works fine but I tried to put everything in docker and I’m receiving this error: [Consumer clientId=consumer-test-1, groupId=test] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected My application.properties: spring.kafka.consumer.bootstrap-servers = localhost:9092 spring.kafka.consumer.group-id=test spring.kafka.consumer.auto-offset-reset = earliest spring.kafka.consumer.key-deserializer= org.apache.kafka.common.serialization.StringDeserializer spring.kafka.consumer.value-deserializer = org.apache.kafka.common.serialization.StringDeserializer spring.kafka.producer.bootstrap-servers = localhost:9092 spring.kafka.producer.key-serializer = ..

Read more

I have set up a kafka docker container with ports mapped to the host windows machine. compose-file: version: ‘2’ services: zookeeper: image: confluentinc/cp-zookeeper:6.0.1 hostname: zookeeper container_name: zookeeper restart: always ports: – "2181:2181" environment: ZOOKEEPER_CLIENT_PORT: 2181 ZOOKEEPER_TICK_TIME: 2000 broker: image: confluentinc/cp-server:6.0.1 hostname: broker container_name: broker restart: always depends_on: – zookeeper ports: – "9092:9092" – "9101:9101" environment: ..

Read more

I am running Kafka/Zookeeper on my Mac; Kafka works fine: I can create topics and send/receive messages to them using the console consumer. However, when trying to start KSQL from a Docker container it does not connect to Kafka Here are the zookeeper and kafka properties: Mac: ~/KAFKA $ grep -v ^# /usr/local/homebrew/etc/kafka/zookeeper.properties dataDir=/usr/local/homebrew/var/lib/zookeeper clientPort=2181 ..

Read more

I have the latest bitnami kafka container installed on a remote server. [2021-04-07 18:05:38,263] INFO Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.ZooKeeper) [2021-04-07 18:05:40,137] INFO Kafka version: 2.7.0 (org.apache.kafka.common.utils.AppInfoParser) My kafka is configured so that I can have external connections. kafka: image: ‘bitnami/kafka:latest’ container_name: kafka ports: – ‘9092:9092’ – ‘9093:9093’ environment: – KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper:2181 – ..

Read more

I want to hear some suggestions on I can do to improve the pipeline to increase the speed when I deploy all my environment(DEV,TQA,STG) I am using Jenkins to deploy and have Docker Kubernetes to support the container. My application uses Kafka Streams and Spring Boot, where many services runs and depends on each other ..

Read more

I am running Confluent Platform all-in-one docker-compose file on my Mac by the steps described in this confluent doc. However, when every container is up (checked using docker-compose ps), I cannot reach the Control Center web interface at http://localhost:9021/. I waited a lot, so it could not be an issue with starting up. I also ..

Read more