Category : logstash

with a python script Im running logstash via command inside a docker container, the normal behavior (with logstash installed in the server) is that after the pipeline get the data that pipeline shuts down, but the process never ends. logstash=subprocess.call(["docker","exec", "-it", "logstash-docker_logstash_1", "/usr/share/logstash/bin/logstash","-f", "/usr/share/logstash/pipeline/site-canvas.conf","–path.data","/usr/share/logstash/config/min-data/"]) Im using docker top to see the running processes inside the ..

Read more

I’m trying to use logstash Jdbc plugin to synchronize data from a Postgres database to some ouput (elastic, rabbitMq). The problem is that logstash is running well every hour (I configured the cronJob like that). Logstash is successfully reading the database but for some reason doesn’t send the messages right away. However, after a few ..

Read more

I want to connect to the elastic search by ip address. but i was failed. i don’t know how to solve it. I constructed elk with docker. ======================================================== elasticsearch.yml enter image description here kibana.yml enter image description here logstash.yml enter image description here docker-compose.yml enter image description here enter image description here Source: Docker..

Read more

Im trying to setup my cluster with elk and kafka inside docker containers, but always logstash cant consume data from the kafka. Producer based on my local machine, not inside docker. I appriciate any help. docker-compose: zoo1: image: confluentinc/cp-zookeeper restart: always container_name: zoo1 ports: – "2181:2181" environment: – ZOO_MY_ID=1 – ZOO_SERVERS=2181 – ZOOKEEPER_CLIENT_PORT=2181 – ALLOW_ANONYMOUS_LOGIN=yes ..

Read more

I get the following error when trying to start logstash on docker-compose error: open /usr/share/logstash/config/logstash.yml: permission denied my docker-compose.yml looks like this version: "3" services: logstash: image: docker.elastic.co/logstash/logstash:7.5.1 ports: – "5044:5044" expose: – "5044" volumes: – ./config/logstash.yml:/usr/share/logstash/config/logstash.yml – ./config/pipelines.yml:/usr/share/logstash/config/pipelines.yml the permission of the folder is drwxr-xr-x. 2 myuser myuser and on the files inside that ..

Read more