I have a kubernetes cluster with a couple of nodes and having a few different kind of pods running.
One of my application pod need to push logs to s3 for production debugging with some sort of user history data.
From my application, i am pushing the logs to the container stdout or console which is the recommended way to print logs in a container.
And i have a filebeat + Elastic search setup to push data to ES and then visualise via Kibana.
But for writing to s3, i would require some log file appender and then a logstash to push to s3.
Is there any other simple option to push logs to s3?
I checked out and came out with fluentd or similar options.
What is the best practice to ship logs to s3 from a container or Kubernetes?
Source: Docker Questions