I'm not seeing one, but just to be sure - was ther...
# flyte-support
a
I'm not seeing one, but just to be sure - was there ever a way to ensure that only X number of a specific task or (even better) a collection of tasks are running at the same time? I'm asking because we have a 4tb FSX lustre drive that is used by many tasks, but if you have many tasks operating on it at the same time - well the drive pretty much deadlocks... so it would be very useful to be able to limit this.
c
I don’t believe there is a global limit indexed by task. There are parallelism limits that can be set on a per execution basis. I’ve wondered if distributed locks or something similar could be used to limit task specific ckncurrency globally tho.
a
yea i see something in map tasks - but this would be for cluster wide - or accross multiple executions
f
@average-secretary-61436 this is an interesting usecase. do you want total number of tasks to be globally limited?
g
@average-secretary-61436, would using queues with Kueue been an option? https://kueue.sigs.k8s.io/docs/overview/ Since 1.16.0 you're able to add annotations to tasks. https://flyte-org.slack.com/archives/C06H1SFA19R/p1752086617752149?thread_ts=1752086615.283179&cid=C06H1SFA19R and https://github.com/flyteorg/flyte/issues/6238 for some additional context
a
Basically - yes a global limit
I have never used kueue before - but I think based on this PR I should be able to use some sort of nodeselector with karpenter nodepools or something like that in the near future. https://github.com/kubernetes-sigs/karpenter/pull/2525