https://flyte.org logo
#flyte-deployment
Title
# flyte-deployment
a

Alex Beach

02/07/2024, 11:20 PM
https://docs.flyte.org/en/latest/deployment/deployment/multicluster.html#control-plane-configuration in a multi cluster deployment, would each data plane need its own docker registry and s3 bucket?
k

Ketan (kumare3)

02/08/2024, 2:23 AM
Why do you need a multi cluster deployment- we recommend this for advanced usecases only
b

Broder Peters

02/08/2024, 6:36 AM
I'm not suuuper deep into the multi cluster setup yet at the company I work, but we have a bucket for each plane. It e.g. stores execution caches from the workflows. We don't have anything specific regarding docker registry besides the one shipped with AWS EKS clusters.
d

David Espejo (he/him)

02/08/2024, 3:09 PM
@Alex Beach regarding the S3 bucket, and more specifically the metadata store it can be shared or per data plane cluster. In terms of the container registry I think having a separate registry per cluster would complicate things (depending on the workflow registration pattern you use)
a

Alex Beach

02/08/2024, 5:49 PM
@Ketan (kumare3) i will have to run one cluster on-prem, one cluster in cloud, and potentially a dev and prod cluster in cloud
the on-prem is going to be interesting... its because we already gpu workstations, so the ideal setup would be that in our flyte deployment, some projects/domains would only run workloads on the specific hardware that we have
d

David Espejo (he/him)

02/08/2024, 9:48 PM
I think there are different layers where the workload placement can be controlled Using cluster execution labels, you can instruct a combination of project/domain to run on a specific K8s cluster (not sure if your workstations run K8s?)
a

Alex Beach

02/08/2024, 9:49 PM
yeah we would run k8s on those workstations
d

David Espejo (he/him)

02/08/2024, 9:51 PM
for more granularity, you can make use of the GPU selectors work that hopefully will land on the docs soon https://github.com/flyteorg/flyte/pull/4172 I think depending on the GPU drivers you use, different keys will be exposed that can be used to configure affinities