Hey peeps, quick question. How can we change the default value for workers when using Map Tasks? I know it’s using K8s-array behind the scene and the default config is that one https://github.com/flyteorg/flyteplugins/blob/master/go/tasks/plugins/array/k8s/config.go#L27-L44 I guess but I couldn’t find an example explaining how to change the value for

Workers

. Is it what

concurrency

is doing when running a Map Task? https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.map_task.html#flytekit-map-task

Cc @Dan Rammer (hamersaw) - concurrency should limit number of pods concurrent right

Correct. So the

k8s-array

plugin as you described attempts to execute all of the map task subtasks concurrently (or as many are configured with the

concurrency

option as you mentioned). It doesn't respect the

max_parallelism

configuration option on the parent workflow.

Perfect thank you 😄