https://flyte.org logo
#ask-the-community
Title
# ask-the-community
f

Frank Shen

11/29/2023, 11:23 PM
Hello, My flyte python tasks are started fast enough in the EKS cluster. However, when the tasks are requesting more memory, e.g. requests=40Gi, it took a long time to initialize the ephemeral pod. What are the strategies to mitigate that? And is there anything wrong with my configs:
Copy code
task_resources:
                defaults:
                  cpu: 2
                  memory: 1Gi
                  storage: 1Gi
                limits:
                  cpu: 20
                  memory: 500Gi
                  storage: 100Gi
                  gpu: 1
...
          cluster_resource_manager:
                customData:
                  - development:
                      - projectQuotaCpu:
                          value: "800"
                      - projectQuotaMemory:
                          value: "3200Gi"
s

Samhita Alla

11/30/2023, 12:41 PM
do you see any logs during the initilization step?