Hello, Question, what is the recommended way to do model serving and model registry with Flyte? I understand Flyte primarily concerns itself with orchestration.

Checkout unionml- it is a thin layer on Flyte. But you can use any serving system. Deep serving integrations are coming. But if you want to deploy to any serving framework invoke them in python For model registry - Flyte is actually a model registry, as you can retrieve artifacts- but many folks use mlflow too

ah nice

Ya we will Love to add more Docs. Cc @broad-monitor-993

I looked at unionml but it's a bit confusing. I wonder if I will give up Flyte functionality for something more simple? I can't see the integration between both systems. Also I'm a bit worried it will lead to to much complexity and maintenance.

You will not give Up anything. It's fully interoperable

hey @plain-stone-38023 we’re working on ways to make the

Flyte Training -> UnionML Serving

user experience smoother, but the idea is that you can still create custom/complex training pipelines with Flyte, but then easily plug it into a unionml app for serving purposes. I added some more detail to this issue: https://github.com/unionai-oss/unionml/issues/96 It’s a high-level proposal, but please feel free to add comments/thoughts in there!

That is something I still need to evaluate myself.