Hey everyone :wave:, I'm trying out the sub-launch...
# flyte-support
c
Hey everyone šŸ‘‹, I'm trying out the sub-launchplans approach to improve the massive fanout issues we experienced with dynamic workflows + subworkflows. That setup was making our workflows really flaky — we encountered a lot of failures and failed pods, which ended up blocking the entire workflow execution. To reduce the fanout, we switched to a
map_task
approach, converting all the previous subworkflows into individual tasks. However, execution time has significantly increased compared to the previous fanout approach. Now, I’d like to experiment with the sub-launchplans approach, which seems to be more efficient (according to the Flyte documentation). However, since I need to iterate over a list to invoke each sub-launchplan, I ran into errors while doing so. My question is: can I invoke sub-launchplans inside a dynamic workflow? I gave it a try, but it's currently failing, so I may be doing something wrong
w
Why would using map_task increase the execution time? Did you set
concurrency
? https://www.union.ai/docs/flyte/user-guide/core-concepts/tasks/map-tasks/