hi team is there any ongoing RFCs or work related to flyte b

Question

hi team is there any ongoing RFCs or work related to flyte backend logging For example improve on propeller logs

Dan Rammer (hamersaw) · Answer

can you elaborate just cleaning up messages and making more accessible

Yubo Wang · Answer

so the logs are not accessible unless look into flytepropeller pod logs

Yubo Wang · Answer

I am imagining `fltyectl log execution ` and can get all the system logs that s related to that execution

Yubo Wang · Answer

similar to what `kubectl logs` can do

Dan Rammer (hamersaw) · Answer

interesting is the idea that this parses logs from all flyte components ie admin propeller datacatalog etc

Yubo Wang · Answer

ideally

Yubo Wang · Answer

so collecting logs from different components actually is annoying when we are trying to debug

Yubo Wang · Answer

often have to jump back and forth between different backend components

Yubo Wang · Answer

I guess it is not an issue if people use datadog integration but at Linkedin we don t have that

Yubo Wang · Answer

< Dan Rammer hamersaw > I can do some kind of poc on this if you think this is interesting I can try deploy fluentd sidecar and try some log streaming with flytectl

Dan Rammer (hamersaw) · Answer

i think this would be really cool my only concern is the diversity in deployments it would be impossible to create a `flytectl log ` command that will work in all scenarios i m wondering if this is something baked into flytectl or a separate debugging script somewhere thoughts