Hi Team, what’s the recommended resource limits for flytepropeller? We’re seeing it OOM even with 4Gb and just a couple of hundred workflows, which is strange.

Yes this is strange

Hey Ketan, I work with @stocky-apple-74569, we're pretty new to Flyte. It's not single binary, we're deploying with the flyte-core chart, basically unchanged from stock config-wise. We haven't looked at cache config at all yet.

Got it

are you running hundred workflows in the same time? how many tasks per workflow

It was 365x 1 workflow with 3 tasks. It seems to have calmed down and it might be because: In a previous version of the task I was passing a VERY long list as an output/input, now the tasks pass a data frame. If the list wasn’t offloaded to the data plane it might have needed to be loaded in memory for each execution. I can see how that would have make flytepropeller unhappy