Hi peeps, is ther ea way to instrument workflows ?
# ask-the-communitye
Endre Karlson
11/30/2023, 2:15 PMHi peeps, is ther ea way to instrument workflows ?
d
Dan Rammer (hamersaw)
11/30/2023, 3:17 PMBy "instrument" do you mean with like telemetry data?
e
Endre Karlson
11/30/2023, 3:17 PMyes indeed
d
Dan Rammer (hamersaw)
11/30/2023, 3:19 PMare you looking for a simple breakdown or exporting to a specific system?
Dan Rammer (hamersaw)
11/30/2023, 3:24 PMWe recently added otel integration into backend components to get a better idea performance overhead that Flyte incurs in orchestration. This is in-line with the overall performance benchmarking RFC effort.
I suspect you're looking for something more targeted breaking apart the task executions internally rather than Flyte's orchestration though. I know there was a little work on exporting some metrics using flytedecks, but I can't seem to find it. @Kevin Su do you know the state of this? The only PRs I can find are here.
Dan Rammer (hamersaw)
11/30/2023, 3:25 PMBut if you're looking for export spans from tasks into something like jaeger, that should be possible without any Flyte components.
e
Endre Karlson
11/30/2023, 5:13 PMsystem / workflow exec times basically