https://flyte.org logo
#flyte-deployment
Title
# flyte-deployment
s

Stephen

07/18/2022, 1:59 PM
Hey peeps, quick question. How can we change the default value for workers when using Map Tasks? I know it’s using K8s-array behind the scene and the default config is that one https://github.com/flyteorg/flyteplugins/blob/master/go/tasks/plugins/array/k8s/config.go#L27-L44 I guess but I couldn’t find an example explaining how to change the value for
Workers
. Is it what
concurrency
is doing when running a Map Task? https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.map_task.html#flytekit-map-task
k

Ketan (kumare3)

07/18/2022, 2:02 PM
Cc @Dan Rammer (hamersaw) - concurrency should limit number of pods concurrent right
d

Dan Rammer (hamersaw)

07/18/2022, 3:28 PM
Correct. So the
k8s-array
plugin as you described attempts to execute all of the map task subtasks concurrently (or as many are configured with the
concurrency
option as you mentioned). It doesn't respect the
max_parallelism
configuration option on the parent workflow.
s

Stephen

07/18/2022, 3:31 PM
Perfect thank you 😄
74 Views