Hi, I'm able to run a certain model on an instance with 32 GiB RAM, but the same model when run with flyte is throwing OOM Error on the same instance type and for the same input parameters. Any thoughts on why this might be happening ?

Have you allocated resources to the task? If so, how much?

Yes, I have allocated the maximum allocatable resource. In this case 27Gi. This is how I've mentioned it for tasks:

@task(cache_version="1.0", cache=True, requests = Resources(cpu = "10" , mem = "27Gi"), limits=Resources(cpu = "10" , mem = "27Gi"))

Can you try setting

ephemeral_storage

to say,

1Gi

? I’m not sure if this will solve the problem, but no harm in giving it a try.

Ok, will check

For your reference: https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.Resources.html#flytekit.Resources