Channels
#flyte-deployment
Title
# flyte-deployment
s
Sören Brunk
02/24/2022, 2:48 PMI have a weird db authentication problem. Using Cloud SQL on GCP with private IP, I created a db and user In another installation where db and username is still the default
my-flyteadmin Copy code
userSettings:
dbHost: xx.xx.xx.xx
dbPassword: secret
datacatalog:
database:
port: 5432
username: "my-flyteadmin"
host: "{{ .Values.userSettings.dbHost }}"
dbname: "my-flyteadmin"
passwordPath: /etc/db/pass.txt
admin:
database:
port: 5432
username: "my-flyteadmin"
host: "{{ .Values.userSettings.dbHost }}"
dbname: "my-flyteadmin"
passwordPath: /etc/db/pass.txtflyteadmin Copy code
run-migrations [error] failed to initialize database, got error failed to connect to `host=xx.xx.xx.xx user=my-flyteadmin database=my-flyteadmin`: server error (FATAL: password authentication failed for user "my-flyteadmin" (SQLSTATE 28P01))datacatalogflyteadminThis is a fresh installation using the chart from current master.
flyteadmin v0.6.104
y
Yuvraj
02/24/2022, 4:11 PMCan you test your db credential directly like this https://docs.flyte.org/en/latest/deployment/aws/manual.html#check-connectivity-to-the-rds-database-from-the-eks-cluster ?
s
Sören Brunk
02/25/2022, 6:55 AM@Yuvraj yes I tried that and it's working fine.
datacatalogflyteadminy
Yuvraj
02/25/2022, 7:13 AMcc: @Prafulla Mahindrakar
s
Sören Brunk
02/25/2022, 7:14 AMGoing back to v0.6.99 fixed the issue for me. Since it appears with v0.6.100, my suspicion is that it could be related to the db changes in
https://github.com/flyteorg/flyteadmin/pull/345 @katrina
p
Prafulla Mahindrakar
02/25/2022, 7:38 AMstrange that it works with default flyteadmin user and db though .
s
Sören Brunk
02/25/2022, 7:42 AMPerhaps I was still using an older version of the chart (and therefore a working flyteadmin version) when I tried with the default flyteadmin user.
Yes I can trigger the issue even with the default flyteadmin user by upgrading to > v0.6.99
p
Prafulla Mahindrakar
02/25/2022, 7:50 AMcool thanks Soren . Do you mind opening an issue for it.
s
Sören Brunk
02/25/2022, 7:59 AMp
Prafulla Mahindrakar
02/25/2022, 12:44 PMHi @Sören Brunk i am unable to reproduce this issue from the master branch .
I am performing the following steps
• cd charts/flyte
• helm install -n flyte -f values.yaml --create-namespace flyte .
Copy code
kubectl get pods -n flyte
NAME READY STATUS RESTARTS AGE
datacatalog-58cdbb6989-lw5mb 1/1 Running 0 4m13s
flyte-contour-contour-7df75dc949-lnfvg 1/1 Running 0 4m13s
flyte-contour-envoy-7bg2h 2/2 Running 0 4m13s
flyte-kubernetes-dashboard-7cb76cfdb5-799gl 1/1 Running 0 4m13s
flyte-pod-webhook-cc799b94-h87r9 1/1 Running 0 4m13s
flyte-spark-operator-6577758bff-khzdt 1/1 Running 0 4m13s
flyteadmin-59f5d5c5f8-bzsl4 2/2 Running 0 4m13s
flyteconsole-6c46567545-2lp9x 1/1 Running 0 4m13s
flytepropeller-86c9444478-sx9pg 1/1 Running 0 4m13s
flytescheduler-595d6dc786-n56jg 1/1 Running 0 4m13s
minio-68744577b6-wspfj 1/1 Running 0 4m13s
postgres-84c58d5c66-knzpz 1/1 Running 0 4m13ss
Sören Brunk
02/25/2022, 12:46 PMI've only tested it using the GCP setup with cloud sql. Sandbox might behave differently.
p
Prafulla Mahindrakar
02/25/2022, 1:52 PMSince this works on sandbox , it seems to be a config issue with GCP. charts. We will try this on an internal GCP setup.
👍 1
s
Sören Brunk
02/25/2022, 2:20 PMNot sure if this is really GCP specific. I think it doesn't show in sandbox because the auth method in sandbox is
trusty
Yuvraj
02/25/2022, 3:09 PM@Sören Brunk I also tested latest flyteadmin on aws and it works fine, AWS have similar config to GCP
s
Sören Brunk
02/25/2022, 3:28 PMHmm that's weird, so maybe it is specific to GCP/Cloud SQL. But I still guess it must be related to some recent changes because older versions work for me too.
p
Prafulla Mahindrakar
03/02/2022, 5:51 AMThis should now be resolved in v0.6.107 of flyteadmin. Thanks @katrina for the fix
65 Views