Setting up sunbird-telemetry Kafka DRUID and superset

I am trying to create a analytics dashboard based from mobile events. I want to dockerize all the components to containers in docker and deploy it in localhost and create an analytical dashboard.

  1. Sunbird telemetry
  2. Kafka
  3. Druid
  4. Superset

What i did


  1. I executed the command docker build -t apache/incubator-druid:tag -f distribution/docker/Dockerfile .

  2. I executed the command docker-compose -f distribution/docker/docker-compose.yml up

  3. After everything get executed open http://localhost:4008/ and see DRUID running

It takes 3.5 hours to complete both build and run


  1. Navigate to kafka folder
  2. docker-compose up -d executed this command

When we execute druid a zookeeper starts running, and when we start kafka the docker file starts another zookeeper and i cannot establish a connection between kafka and zookeeper.
After i start sunbird telemetry and tries to create topic and connect kafka from sunbird its not getting connected.

I dont understand what i am doing wrong.
Can we tell kafka to share the zookeeper started by DRUID. I am completed new to this environment and these stacks.
I am studying this stacks. Am i doing something wrong. Can anybody point out how to properly connect kafka and druid over docker.

Note:- I am running all this in my mac

Source: StackOverflow