https://flyte.org logo
#ask-the-community
Title
# ask-the-community
l

Lev Udaltsov

06/06/2023, 1:34 PM
Hi folks, Running some workflows on using Flyte + GKE and some Tasks get stuck on
Running
with the following error:
Copy code
Exceeded resourcequota: [BackOffError] The operation was attempted
        but failed, caused by: pods "fefe21c746a0b4964b45-n0-0" is forbidden: exceeded
        quota: project-quota, requested: limits.cpu=600m, used: limits.cpu=64, limited:
        limits.cpu=64
In
flyte_values.yaml
I have
Copy code
- projectQuotaCpu:
                value: '64'
yet on GKE I have much fever than 64 vCPUs requested. How does Flyte determine how many CPUs are you using in your project? Is it based on Limits for Tasks rather than Requests? Anyone have a similar issue before?
k

Ketan (kumare3)

06/06/2023, 1:44 PM
Yes it is based on limits on the task or default Limits set at the project level applied to every task that does not really request some
l

Lev Udaltsov

06/06/2023, 1:46 PM
so having
Copy code
task_resource_defaults:
    task_resources:
      defaults:
        cpu: 250m
        memory: 500Mi
        storage: 100Mi
      limits:
        cpu: 32
        memory: 120Gi
        storage: 32Gi
is problematic here since it sets
cpu: 32
as limit for some tasks?
All the task have Limits manually configured however
@Ketan (kumare3) I see now that I do have 8 tasks running the limit on each of which is 8GB so this must be the issue, thanks for clarifying!
72 Views