Hi folks.. Question about map_tasks. I have a dynamic which triggers 2 map_tasks (same task really but to handle the fan out which is more than 5k). Earlier I would see both trigger simultaneously and I handled the processing concurrency accordingly but in my most recent run I saw them getting serialized despite no dependency between them. I’ve recently updated to 1.13 (flytekit and backend so need to check if this is happening in all workflows) Code looks like this:

@dynamic
def my_dynamic_wf():
    results = []
    ... 
    Create some chunks of task inputs
    ...
    for c in chunks:
         results.append(map_task().......)

    flatten_results(results)

They should be parallel, do you see the graph as serial

graph shows parallel.. but for some bizarre reason they fired 1 after the other

Max parallelism

?

How many nodes in the graph

4... 1 -> 2 map tasks (wanted to run 50 in parallel for each) -> 1