https://flyte.org logo
#flyte-on-gcp
Title
# flyte-on-gcp
g

Griffin Brome

01/02/2024, 8:05 PM
Hello everyone, really cool to see everything happening with this project! My shop is currently on GCP, and I am trying to deploy Flyte to our k8s cluster running there. There is very good reference implementation here, for spinning everything up from scratch, but I am not so sure about using our already provisioned resources. If possible, could anyone please elaborate on what one would need to modify or change in order to do this? Thank you in advance! 🙏
d

David Espejo (he/him)

01/02/2024, 11:27 PM
Welcome Griffin! So, besides the GKE cluster, what other resources have you provisioned already?
g

Griffin Brome

01/03/2024, 12:40 AM
Hi David! Really appreciate all you’ve been doing for the community. I also have a DB (Google Cloud SQL) and a Cloud Storage bucket
d

David Espejo (he/him)

01/03/2024, 3:47 PM
Ok, I think at this point you can use the reference implementation for guidance but it's probably not very useful to actually run the modules. You'll need to create a new database in your DB server and, for clarity, a new storage bucket for Flyte to store metadata. Once you have this, you can indicate the required information in the
values-gcp.yaml
file and then run a helm installation against the
flyte
namespace. Do you have an Ingress controller already in place?
g

Griffin Brome

01/03/2024, 5:27 PM
No, not yet
f

Fabio Grätz

01/03/2024, 5:34 PM
In theory one can
terraform import
existing resources.
Do you have any data in your existing database you want to preserve?
Deleting and recreating with the union oss module is definitely quicker.
g

Griffin Brome

01/03/2024, 5:36 PM
We are using postgres, is it possible to define a new
flyte
schema and isolate there?
d

David Espejo (he/him)

01/03/2024, 6:21 PM
In theory, yes. In the other hand, the modules configure the DB to use Private Services Connect and some specific CIDR ranges. I'm not sure how it would interact with your current installation
g

Griffin Brome

01/03/2024, 6:33 PM
Would it be best to just provision a fresh DB?
d

David Espejo (he/him)

01/03/2024, 6:51 PM
I'd say so
g

Griffin Brome

01/03/2024, 6:56 PM
Ok, fair enough
3 Views