Hey everyone š,
I'm trying out the
sub-launchplans approach to improve the massive fanout issues we experienced with
dynamic workflows + subworkflows. That setup was making our workflows really flaky ā we encountered a lot of failures and failed pods, which ended up blocking the entire workflow execution.
To reduce the fanout, we switched to a
map_task
approach, converting all the previous subworkflows into individual tasks. However, execution time has significantly increased compared to the previous fanout approach.
Now, Iād like to experiment with the
sub-launchplans approach, which seems to be more efficient (according to the Flyte documentation). However, since I need to iterate over a list to invoke each sub-launchplan, I ran into errors while doing so.
My question is:
can I invoke sub-launchplans inside a dynamic workflow?
I gave it a try, but it's currently failing, so I may be doing something wrong
