Channels
announcements
ask-the-community
auth
conference-talks
contribute
databricks-integration
datahub-flyte
deployment
ecosystem-unionml
engineeringlabs
events
feature-discussions
flyte-bazel
flyte-build
flyte-console
flyte-deployment
flyte-documentation
flyte-github
flyte-on-gcp
flyte-ui-ux
flytekit
flytekit-java
flytelab
great-content
hacktoberfest-2022
helsing-flyte
in-flyte-conversations
integrations
introductions
jobs
konan-integration
linkedin-flyte
random
ray-integration
ray-on-flyte
release
scipy-2022-sprint
show-and-tell
sig-large-models
torch-elastic
workflow-building-ui-proj
writing-w-sfloris
Title
f
Felix Ruess
01/09/2023, 5:52 PMHi, does anyone know why tasks that were executed as part of a workflow don't show up in the console task execution list?
Same goes for workflows that were executed as subworkflows...
Is this a bug or a missing feature or am I missing something else?
d
Dan Rammer (hamersaw)
01/09/2023, 6:59 PM@Felix Ruess can you provide an example?
f
Felix Ruess
01/09/2023, 7:08 PMLet my try to elaborate: I created a simple workflow with some container tasks (all in one file). When I run the workflow (runs fine) I can see the execution of this workflow in the flyte console. But if I go to the one of the tasks directly, it doesn't show any executions (although they clearly ran as part of the workflow).
Sometimes we also launch these tasks directly, then they show up in the task execution.
Same for subworkflows...
I can also provide some screenshots if that helps
d
Dan Rammer (hamersaw)
01/09/2023, 7:11 PMoh ok, i think i understand. the "recent executions" for a task are not displayed, even though they have executed as part of a previous workflow. this same behavior occurs with subworkflows as well.
so i'm guessing @Jason Porter may be able to elaborate on the front-end portion of this a little more, but i believe the recent executions are only populated by launchplan executions.
f
Felix Ruess
01/09/2023, 7:15 PMyeah, that would explain it
d
Dan Rammer (hamersaw)
01/09/2023, 7:15 PMi believe all of the information is there to populate the recent executions at the granularity you're suggesting however the system is currently not optimized for it. we would have to do a little reconnaissance to figure out how difficult it would be to add.
f
Felix Ruess
01/09/2023, 7:17 PMThat would be nice! I'm interested in this since I want to know how long specific tasks took over the last X executions... and I was expecting to see that in the recent executions...
d
Dan Rammer (hamersaw)
01/10/2023, 4:22 PMcc @Jason Porter - adding all task executions to the UI for recent executions rather than just those started from a launchplan.
@Felix Ruess another option would be to directly query the admin DB
flyteadmin=# select created_at, started_at, duration, updated_at from task_executions where project='flytesnacks' and domain='development' and name='hello-world.say_hello';
created_at | started_at | duration | updated_at
-------------------------------+-------------------------------+-------------+-------------------------------
2023-01-10 16:17:30.883911+00 | 2023-01-10 16:18:38.725563+00 | 20003019445 | 2023-01-10 16:18:58.74241+00
2023-01-10 16:17:30.911923+00 | 2023-01-10 16:18:38.743901+00 | 20020004138 | 2023-01-10 16:18:58.776041+00
(2 rows)