https://flyte.org logo
#ask-the-community
Title
# ask-the-community
m

Michael Tinsley

03/01/2023, 9:12 AM
I’ve installed Flyte via the flyte-binary Single cluster simple cloud deployment path whilst testing and exploring. However, the default task resource limits are too low and I’m struggling to find where I would define these to override the defaults? Could anyone point me in the correct direction? Thanks
s

Sören Brunk

03/01/2023, 12:15 PM
You can edit the flyte-binary-config configmap and add task resources. i.e.:
Copy code
010-inline-config.yaml: |                                                                                                                                                                                          
    plugins:                                                                                                                                                                                                         
      k8s:                                                                                                                                                                                                           
        default-env-vars:                                                                                                                                                                                            
        - FLYTE_AWS_ENDPOINT: <http://sandbox-minio.flyte:9000>                                                                                                                                                        
        - FLYTE_AWS_ACCESS_KEY_ID: minio                                                                                                                                                                             
        - FLYTE_AWS_SECRET_ACCESS_KEY: miniostorage                                                                                                                                                                  
    task_resources:                                                                                                                                                                                        
      defaults:                                                                                                                                                                                             
        cpu: 1                                                                                                                                                                                              
        memory: 4Gi                                                                                                                                                                                         
        storage: 5Gi                                                                                                                                                                                        
      limits:                                                                                                                                                                                                
        cpu: 16                                                                                                                                                                                                                                                                                                                                                                                          
        memory: 16Gi                                                                                                                                                                                         
        storage: 20Gi
Or edit the your corresponding values if you're using the helm chart.
m

Michael Tinsley

03/01/2023, 12:35 PM
Ah great, thank you - I will give that a go now
k

Ketan (kumare3)

03/01/2023, 3:53 PM
Ya this has been updated now
There is a PR that removes all defaults
a

Abin Shahab

09/14/2023, 10:58 PM
This is still not working for me.
Why is there resource limits on a demo cluster?
and if so, why isn't it overridable from inside the task?
d

David Espejo (he/him)

09/15/2023, 4:05 PM
Hi @Abin Shahab I just reproduced this on the local sandbox (
flytectl version 0.6.45
) and the limits are applied if they land on the configmap 1.
kubectl edit cm flyte-sandbox-config -n flyte
2. Find the
100-inline-config.yaml
section and add the
task_resources
section described on this thread (adjust numbers to match your needs) That will set platform-wide resource limits, which is the max amount of resources users can request on a Task.
a

Abin Shahab

09/15/2023, 4:09 PM
ok
I have a different question, It seems that the sandbox cluster cannot launch ray clusters
is that right?
d

David Espejo (he/him)

09/15/2023, 4:15 PM
unfortunately, that seems to be the case right now. There's a recent issue reported: https://github.com/flyteorg/flyte/issues/4026
a

Abin Shahab

09/15/2023, 4:16 PM
where is the code different for the sandbox?
Where can I find the ray-dashboard?
74 Views