:wave: we’re currently testing out multiple projects on our Flyte deployment with k8s submitting pod...

brash-london-45337

02/10/2022, 7:15 PM

👋 we’re currently testing out multiple projects on our Flyte deployment with k8s submitting pods to the project namespace. Is there a recommended way of dynamically creating/syncing these resources? We found https://github.com/flyteorg/flyte/blob/master/deployment/sandbox/flyte_generated.yaml#L3537 but am unsure what

Copy code

- command:
            - flyteadmin
            - --config
            - /etc/flyte/config/*.yaml
            - clusterresource
            - sync

does and I couldn’t seem to find any documentation around that. cc @miniature-carpenter-95169

acceptable-policeman-57188

02/10/2022, 7:22 PM

hey @brash-london-45337 sync cluster resources should be the way to go! there should be some docs here: https://docs.flyte.org/en/latest/deployment/cluster_config/general.html#cluster-resources but tl;dr you can use the controller to dynamically provision per-namespace k8s resources

acceptable-policeman-57188

02/10/2022, 7:23 PM

these docs could definitely be fleshed out more 😅 so please let us know if you have specific questions in the meantime we can help with

🙏 1

acceptable-policeman-57188

02/10/2022, 7:33 PM

this is how we use the controller to set per-namespace project quota in the core flyte deployment: https://github.com/flyteorg/flyte/blob/master/charts/flyte-core/values.yaml#L647,L693

brash-london-45337

02/10/2022, 9:50 PM

Thanks for the pointers @acceptable-policeman-57188! Will try a few things on our end and will raise questions if we come across them 🙂

👍 1

167 Views

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.