https://flyte.org logo
Powered by
#ask-the-community
Title
# ask-the-community
a

Aswanth Krishnan

03/01/2023, 11:26 AM
our flyte-sandbox container often crashes when using multiple heavy containers. The hardware for the sandbox is a fairly powerful node with enough RAM and CPU resources. Any pointers on debuging this will be really helpful!
k

Ketan (kumare3)

03/01/2023, 3:51 PM
Did you change the docker daemon to have more cpu / mem
Cc @jeev
d

David Espejo (he/him)

03/01/2023, 4:01 PM
@Aswanth Krishnan currently the minimum requirements for the Docker daemon are 4CPUs and 3GB RAM https://docs.flyte.org/projects/cookbook/en/latest/index.html#running-workflows-in-a-flyte-cluster Please let us know if this answers your question
j

jeev

03/01/2023, 4:25 PM
the docker daemon resources is a mac thing because of the virtualization i believe. is this running on linux?
ah this might be because of the resources:
Copy code
resources:
      limits:
        memory: 1Gi
      requests:
        cpu: "1"
        memory: 1Gi
@Aswanth Krishnan this will need a fix in the chart and sandbox configuration. i think we should just drop the resource limits entirely. in the meantime, you can try manually editing the deployment to see if that helps you.
Copy code
kubectl edit deploy flyte-sandbox -n flyte
a

Aswanth Krishnan

03/01/2023, 4:31 PM
I am running on a Linux server with 88 cores and ~800 GB RAM. I have not yet played around with resource limits. @jeev thanks for your help. I will try this out and let you know if it helps!
j

jeev

03/01/2023, 4:31 PM
@Yee: cc
we can push out a fix for this in the next release
@Aswanth Krishnan: 1.4.0 release should fix this.
3 Views
Powered by