Hey everyone slightly smiling face I have a question about t Flyte #flyte-support

Hey everyone :slightly_smiling_face: I have a que...

cool-lifeguard-49380

11/29/2023, 12:09 PM

Hey everyone 🙂 I have a question about the

pyflyte run --max-parallelism

option of executions. Even when setting it to 1, I see multiple pods scheduled at the same time while I would have expected only a single one. Am I misunderstanding this option? Is the same for you as well?

hallowed-mouse-14616

11/29/2023, 1:23 PM

What version of Flyte are you running? I know there was a lingering issue where max-parallelism was not correctly tracked on multiple node evaluations within the same propeller round.

hallowed-mouse-14616

11/29/2023, 1:23 PM

You are entirely correct though, we expect only one Pod.

cool-lifeguard-49380

11/29/2023, 2:15 PM

<http://cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0|cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0>

cool-lifeguard-49380

11/29/2023, 2:16 PM

We are using a very recent one 🤔

hallowed-mouse-14616

11/29/2023, 2:16 PM

😅 interesting. I'll take a look here in a bit.

hallowed-mouse-14616

11/29/2023, 2:29 PM

alright, so IIUC we're cutting a new release today or tomorrow that will include this fix. i just tested again and in 1.11

max-parallelism

configuration with be respected correctly.

🙌🏽 1

cool-lifeguard-49380

11/29/2023, 2:41 PM

Oh wow awesome!

cool-lifeguard-49380

11/29/2023, 2:42 PM

Looking forward to test 🙂

cool-lifeguard-49380

11/30/2023, 10:50 AM

Ran this in our staging cluster, can confirm it works 🙂

5 Views

Open in Slack

Previous Next