https://flyte.org
Join Slack
Hey everyone :slightly_smiling_face: I have a question about the `pyflyte run --max-parallelism` op...
# flyte-support
c
Hey everyone 🙂 I have a question about the 
pyflyte run --max-parallelism
option of executions. Even when setting it to 1, I see multiple pods scheduled at the same time while I would have expected only a single one. Am I misunderstanding this option? Is the same for you as well?
h
What version of Flyte are you running? I know there was a lingering issue where max-parallelism was not correctly tracked on multiple node evaluations within the same propeller round.
You are entirely correct though, we expect only one Pod.
c
<http://cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0|cr.flyte.org/flyteorg/flytepropeller-release:v1.10.0>
We are using a very recent one 🤔
h
😅 interesting. I'll take a look here in a bit.
alright, so IIUC we're cutting a new release today or tomorrow that will include this fix. i just tested again and in 1.11 
max-parallelism
configuration with be respected correctly.
🙌🏽 1
c
Oh wow awesome!
Looking forward to test 🙂
Ran this in our staging cluster, can confirm it works 🙂
4 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by