Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Does Flyte support a multi-cluster deployment with `multiple cloud providers`? For example, can the data planes be distributed across a mixture of GCP clusters and AWS clusters? This <https://docs.flyte.org/en/latest/deployment/deployment/multicluster.html|doc> is not very clear whether it’s possible or not.

even if it is possible, this is thoroughly untested at least in oss and we do not recommend this.

you’d also need to pay a substantial amount of care around performance and cross-provider network/data traffic costs.

that said this is one of the features supported by union cloud

the multi-cluster deployment guide is generally for multiple data clusters, or for users who want to split control plane and data plane.

the exception to the above is that people have successfully used both aws and on-prem.  however i don’t know of any oss users who have used both aws and gcp

<@U04UNGML8NB> it’s possible but not tested and there are a few rough edges or some missing parts as this is not common. Core Flyte is portable by design

<http://Union.ai|Union.ai> s hosted implementation is out of the box supports multi cluster like kubelets and you can indeed bring up clusters anywhere - happy to talk about u ion as well

Thank you both for the clarification! The reason I asked is because I think it might be cost efficient to utilize spot instances from both cloud providers to run more workflows. Sounds like <http://union.ai|union.ai> only supports cluster deployment within single cloud provider?

No infact the reverse, but we would love to talk more

oh, i misunderstood, great! I’d love to know more

Let’s schedule a chat sometime? Meanwhile, is there any doc on how to do that with <http://union.ai|union.ai>?

cc <@U05APRYNB7Y> can you help to connect

<@U04UNGML8NB> great to e-meet.  happy to find time for us to chat

Thanks for reaching out, Sean! I haven’t extensively discussed this idea with my team, but I’d like to learn about the solutions <http://union.ai|union.ai> can offer. Let’s meet virtually sometime this week or next.