hi team, is there any ongoing RFCs or work related...
# contributel
limited-raincoat-94253
06/08/2023, 6:57 PMhi team, is there any ongoing RFCs or work related to flyte backend logging? For example, improve on propeller logs
h
hallowed-mouse-14616
06/08/2023, 7:09 PMcan you elaborate? just cleaning up messages and making more accessible?
l
limited-raincoat-94253
06/08/2023, 7:11 PMso, the logs are not accessible unless look into flytepropeller pod logs
limited-raincoat-94253
06/08/2023, 7:11 PMI am imagining
fltyectl log execution...limited-raincoat-94253
06/08/2023, 7:12 PMsimilar to what
kubectl logsh
hallowed-mouse-14616
06/08/2023, 7:21 PMinteresting, is the idea that this parses logs from all flyte components (ie. admin, propeller, datacatalog, etc)?
l
limited-raincoat-94253
06/08/2023, 7:21 PMideally
limited-raincoat-94253
06/08/2023, 7:22 PMso collecting logs from different components actually is annoying when we are trying to debug
limited-raincoat-94253
06/08/2023, 7:22 PMoften have to jump back and forth between different backend components
limited-raincoat-94253
06/08/2023, 7:23 PMI guess it is not an issue if people use datadog integration, but at Linkedin, we don’t have that
limited-raincoat-94253
06/08/2023, 8:01 PM@hallowed-mouse-14616 I can do some kind of poc on this if you think this is interesting. I can try deploy fluentd sidecar and try some log streaming with flytectl
h
hallowed-mouse-14616
06/08/2023, 11:00 PMi think this would be really cool! my only concern is the diversity in deployments, it would be impossible to create a
flytectl log ...149 Views