hi y’all! I am using <https://grafana.com/grafana/...
# flyte-deployment
f
hi y’all! I am using https://grafana.com/grafana/dashboards/13980 and see that the workflow query uses
Copy code
label_values(flyte:propeller:all:collector:flyteworkflow, wf)
When I look at my propeller prom metrics however the
wf
label is empty. Why?
Copy code
# HELP flyte:propeller:all:collector:flyteworkflow Current FlyteWorkflow levels per instance of propeller
# TYPE flyte:propeller:all:collector:flyteworkflow gauge
flyte:propeller:all:collector:flyteworkflow{domain="development",project="testproject",task="",wf=""} 1
k
@Fabian Baier, it seems it has the domain right?
Copy code
flyte:propeller:all:collector:flyteworkflow{`domain="development"`,project="testproject",task="",wf=""}
f
yep, but
wf
is empty
k
ya, let me find this metric
cc @Dan Rammer (hamersaw) do you know this off the top?
d
unfortunately no. i should probably spend a bit cycling through all the emitted metrics. i can look into it?
k
can you that would help
👍 1
d
OK, it looks like the
flyte:propeller:all:collector
metric is used for "metrics that show the current number of Flyte workflows, by project and domain". So basically, we periodically list all FlyteWorkflow CRDs and emit a metric showing aggregate numbers for project / domain combinations. Since we are showing combined counts over project / domains populating a wf and task value doesn't really make sense in this context. I'm not sure if the
task
and
wf
labels have been orphaned by updates, or if they have been applied incorrectly ... looking a little deeper.
176 Views