https://flyte.org logo
#ask-the-community
Title
# ask-the-community
f

Fabio Grätz

11/29/2023, 12:09 PM
Hey everyone 🙂 I have a question about the
pyflyte run --max-parallelism
option of executions. Even when setting it to 1, I see multiple pods scheduled at the same time while I would have expected only a single one. Am I misunderstanding this option? Is the same for you as well?
d

Dan Rammer (hamersaw)

11/29/2023, 1:23 PM
What version of Flyte are you running? I know there was a lingering issue where max-parallelism was not correctly tracked on multiple node evaluations within the same propeller round.
You are entirely correct though, we expect only one Pod.
f

Fabio Grätz

11/29/2023, 2:15 PM
<http://cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0|cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0>
We are using a very recent one 🤔
d

Dan Rammer (hamersaw)

11/29/2023, 2:16 PM
😅 interesting. I'll take a look here in a bit.
alright, so IIUC we're cutting a new release today or tomorrow that will include this fix. i just tested again and in 1.11
max-parallelism
configuration with be respected correctly.
f

Fabio Grätz

11/29/2023, 2:41 PM
Oh wow awesome!
Looking forward to test 🙂
Ran this in our staging cluster, can confirm it works 🙂
4 Views