Hey everyone! Has anyone used flyte for model serving? I'm new to flyte but trying to set up some workflows with ray serve. Has anyone experimented with this before?

I recently wrote a blog post on serving models with Banana: https://flyte.org/blog/how-to-serve-ml-models-with-banana. Haven't tried Ray serve, though. Join our community sync today where I'd be demoing the Banana integration, in case you're interested!

No one has tried ray serve with Flyte

Seems like the banana workflow is more for separating serving from flyte, and just serving models trained with Flyte. I guess more broadly people aren’t using flyte with any kind of serving tools? But I’ll take a look at the proxy idea

Ya