helpful-lighter-24518
11/13/2024, 10:20 AMmaxParallelism
only controls how many tasks within a single workflow can run concurrently, so it doesn’t solve our problem of limiting the total number of running workflows per project.
I’m considering using task resource limits (CPU, GPU, memory) to control the amount of resources per task as a workaround. We could manually adjust these limits for each project. However, I’d love to hear if there are better strategies or best practices for this scenario.
Also, is there a way to set a default timeout for every task globally, unless the user explicitly specifies a different timeout with @task(timeout=timedelta(hours=1))
?
Thanks in advance for any advice! 🙏average-finland-92144
11/13/2024, 4:04 PMaverage-finland-92144
11/13/2024, 4:09 PMtimeout
in the task metadata, it's something we could try