hi team, is there any ongoing RFCs or work related...
# contributey
Yubo Wang
06/08/2023, 6:57 PMhi team, is there any ongoing RFCs or work related to flyte backend logging? For example, improve on propeller logs
d
Dan Rammer (hamersaw)
06/08/2023, 7:09 PMcan you elaborate? just cleaning up messages and making more accessible?
y
Yubo Wang
06/08/2023, 7:11 PMso, the logs are not accessible unless look into flytepropeller pod logs
Yubo Wang
06/08/2023, 7:11 PMI am imagining
fltyectl log execution...Yubo Wang
06/08/2023, 7:12 PMsimilar to what
kubectl logsd
Dan Rammer (hamersaw)
06/08/2023, 7:21 PMinteresting, is the idea that this parses logs from all flyte components (ie. admin, propeller, datacatalog, etc)?
y
Yubo Wang
06/08/2023, 7:21 PMideally
Yubo Wang
06/08/2023, 7:22 PMso collecting logs from different components actually is annoying when we are trying to debug
Yubo Wang
06/08/2023, 7:22 PMoften have to jump back and forth between different backend components
Yubo Wang
06/08/2023, 7:23 PMI guess it is not an issue if people use datadog integration, but at Linkedin, we don’t have that
Yubo Wang
06/08/2023, 8:01 PM@Dan Rammer (hamersaw) I can do some kind of poc on this if you think this is interesting. I can try deploy fluentd sidecar and try some log streaming with flytectl
d
Dan Rammer (hamersaw)
06/08/2023, 11:00 PMi think this would be really cool! my only concern is the diversity in deployments, it would be impossible to create a
flytectl log ...149 Views