Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hi everyone, we have a use-case where we want to create workflows on the fly, possibly driven by a UX builder.  This can mean possible 1000's of custom workflows. We can handle the cruft of converting JSON -&gt; the python sdk for flyte, and registering the new workflows.

What we are unsure of is if Flyte can handle these many custom workflows. Is this a use-case thats been tried before?
And possibly is there another way instead of JSON -&gt; PythonSDK?

Thanks a lot for your help.

Union the hosted offering actually has a graphical workflow builder.

i would avoid the python sdk if you’re working on the front-end.  you shouldn’t have to think about that at all if you’re working in js/ts.

the <https://github.com/flyteorg/flyte/tree/master/flyteidl/gen/pb-es/flyteidl|generated code> should be enough to get you talking to the flyte control plane.

1000s of custom workflows is not a problem, pretty low still