Is there a way to configure the scheduler or flyte...
# ask-the-communityl
Laura Lin
03/02/2023, 3:46 PMIs there a way to configure the scheduler or flyte in some way to only allow at most N instances of a certain workflow/task to run at the same time in a namespace?
k
Ketan (kumare3)
03/02/2023, 3:47 PM
Yup
Ketan (kumare3)
03/02/2023, 3:47 PM
You don’t have to configure scheduler
Ketan (kumare3)
03/02/2023, 3:47 PM
You can do that per workflow or per project - call max-parallelism
Ketan (kumare3)
03/02/2023, 3:48 PM
If you want to limit core use - resource quotas
l
Laura Lin
03/02/2023, 3:49 PMmostly lets say I have a workflow making unsafe updates to a database and I just want to ensure that we only ever have one of these workflows running at a time.
Laura Lin
03/02/2023, 3:51 PMControls the maximum number of task nodes that can be run in parallel for the entire workflow. This is useful to achieve fairness.k
Ketan (kumare3)
03/02/2023, 4:12 PM
That is not supported today
l
Laura Lin
03/02/2023, 4:17 PMah ok thanks.
k
Ketan (kumare3)
03/02/2023, 4:58 PM
But this is great, we would probably add this as a feature
Ketan (kumare3)
03/02/2023, 4:58 PM
As Flyte has resource manager
l
Laura Lin
03/02/2023, 5:35 PMas a feature req, it would also be good to have an option to also be able to do this across namespaces, in case I've got a shared resource that both my dev/prod/wtv workflows are hitting
k
Kevin Su
03/02/2023, 5:43 PM@Laura Lin mind creating a issue here [flyte-core]
s
Slackbot
03/02/2023, 5:43 PM⭐ Create a new Flyte Core Feature issue: https://github.com/flyteorg/flyte/issues/new?assignees=&labels=enhancement%2Cuntriaged&template=feature_request.yaml&title=%5BCore+feature%5D+
k
Ketan (kumare3)
03/02/2023, 6:13 PM
yes, please add the details
Ketan (kumare3)
03/02/2023, 6:13 PM
again this is not prioritized, but good to have it in the the set of things to do
156 Views