Hi, wondering what people are using for viewing/archiving container logs on self managed on prem k8s... did anyone find a nice setup yet, since flyte can't collect and archive task logs for you?
Thanks! The ELK stack is too heavy weight for me.
Right now I'm using parts of the Grafana LGTM stack (so Loki for logs), but was wondering if there is an even simpler solution e.g. via a sidecar that uploads the logs to S3 (e.g. Argo workflows already has something like that integrated).
Spent a while fiddling with the config so happy to answer any questions if you decide to go down that route. https://vector.dev/ may also be of interest
f
Felix Ruess
01/09/2023, 6:10 PM
cool, thanks!
I'll go with grafana agent operator (also creates daemonsets to scrape logs and metrics) and see how it goes...