Category : fluentd

I’m working on collecting logs from docker containerized application. I’m able to bring the logs to stdout output plugin but when I am trying syslog output plugin then it is not writing on syslog server. Below is the configuration file. [SERVICE] Parsers_File /etc/td-agent-bit/parsers.conf [INPUT] Name forward [Output] name syslog match * host 127.0.0.1 port 514 ..

Read more

I am trying to setup EFK stack in a aws cluster using helm. These are the steps I followed. Created a separate namespace logging Installed elastic search helm install elasticsearch elastic/elasticsearch -f values.yml -n logging values.yml # Shrink default JVM heap. esJavaOpts: "-Xmx128m -Xms128m" # Allocate smaller chunks of memory per pod. resources: requests: cpu: ..

Read more

ref: https://docs.fluentd.org/language-bindings/nodejs As per the reference above, I don’t want to use this as it is. My requirement is to get nodejs logs from the container inside from path and sent them to s3. what is the possible ways (fluentd plugins)if i don’t want to use nodejs fluentd input plugin and simply define the path(where ..

Read more

We are using AWS Elasticsearch Service and fleuntd to push the logs of microservice. We have installed fluentd on EC2 instance using docker based configuration. We have followed the steps mentioned in the https://docs.fluentd.org/container-deployment/docker-compose and also it was working pretty fine till last week. There is no change in the configuration of both elastcicsearch service ..

Read more

i’m trying to parse logs from my docker container. I’m using docker fluentd driver and I can’t extract exactly what I want. In the first attempt my fluentd conf is this: <source> @type forward port 24224 bind 0.0.0.0 </source> <match docker.mycontainer*> @type copy <store> @type elasticsearch host 192.168.0.35 port 9200 logstash_format true logstash_prefix mycontainer- logstash_dateformat ..

Read more

Hi I have 2 Google cloud VM ( ubuntu) where I have following configuration for docker : Machine 1 has : Docker version 18.03.1-ce, build 9ee9f40 Machine 2 has : Docker version 20.10.0, build 7287ab3 1. I tried with docker compose file on both machines SERVIC_NAME: image: IMAGE_NAME container_name: CONTAINER_NAME expose: – "1311" ports: – ..

Read more