Sebastia Agramunt

05/17/2022, 7:14 PM
Hi, newbie question… Do I really need kubernetes to run Flyte?. I need to run ML workflows on docker images for a small (but growing) project.


05/17/2022, 7:43 PM
for now unf yes. all the processing is tied to k8s/etcd/CRDs, etc.
the idea to support additional backend has been kicking around for a while but it’s just an idea for now.
to clarify ofc, the tasks themselves, the atomic unit of compute in flyte, do not necessarily need to run on k8s (hive tasks for instance do not run on k8s), but the platform itself does
what’s your situation look like? we’ve tried to make the launching of eks as simple as possible.
also union has a hosted offering which can help alleviate the pain

Sebastia Agramunt

05/18/2022, 12:18 PM
I believe this is more complex than I thought. Thank you for the response