<https://docs.flyte.org/en/latest/deployment/deplo...
# flyte-deployment
a
https://docs.flyte.org/en/latest/deployment/deployment/multicluster.html#control-plane-configuration in a multi cluster deployment, would each data plane need its own docker registry and s3 bucket?
k
Why do you need a multi cluster deployment- we recommend this for advanced usecases only
b
I'm not suuuper deep into the multi cluster setup yet at the company I work, but we have a bucket for each plane. It e.g. stores execution caches from the workflows. We don't have anything specific regarding docker registry besides the one shipped with AWS EKS clusters.
d
@Alex Beach regarding the S3 bucket, and more specifically the metadata store it can be shared or per data plane cluster. In terms of the container registry I think having a separate registry per cluster would complicate things (depending on the workflow registration pattern you use)
a
@Ketan (kumare3) i will have to run one cluster on-prem, one cluster in cloud, and potentially a dev and prod cluster in cloud
the on-prem is going to be interesting... its because we already gpu workstations, so the ideal setup would be that in our flyte deployment, some projects/domains would only run workloads on the specific hardware that we have
d
I think there are different layers where the workload placement can be controlled Using cluster execution labels, you can instruct a combination of project/domain to run on a specific K8s cluster (not sure if your workstations run K8s?)
a
yeah we would run k8s on those workstations
d
for more granularity, you can make use of the GPU selectors work that hopefully will land on the docs soon https://github.com/flyteorg/flyte/pull/4172 I think depending on the GPU drivers you use, different keys will be exposed that can be used to configure affinities