Hey!
No idea why pods are not successfully deploye...
# ask-the-communityh
Hafsa Junaid
04/27/2022, 3:04 AMHey!
No idea why pods are not successfully deployed, Following doc as it is https://docs.flyte.org/en/latest/deployment/gcp/manual.html#deployment-gcp-manual
h
Haytham Abuelfutuh
04/27/2022, 3:05 AM
Can you attempt to get the logs?
Haytham Abuelfutuh
04/27/2022, 3:05 AM
kubectl logs -n flyte svc/flyteadmin -c run-migrationsh
Hafsa Junaid
04/27/2022, 3:06 AMmessage has been deleted
k
Kevin Su
04/27/2022, 3:39 AM@Hafsa Junaid are you using M1 Mac ?
h
Hafsa Junaid
04/27/2022, 3:41 AMits ubuntu 20.4 on hp
h
Haytham Abuelfutuh
04/27/2022, 3:43 AM
kubectl logs -n flyte flyteadmin-<pod I'd> -c run-migrationsYou may want to add -p to the commandh
Hafsa Junaid
04/27/2022, 3:48 AMmessage has been deleted
Hafsa Junaid
04/27/2022, 3:54 AMsame error
h
Haytham Abuelfutuh
04/27/2022, 3:56 AM
The error is that it's trying to connect to database on host "postgres".. but that doesn't sound right... Where is the db located?
h
Hafsa Junaid
04/27/2022, 3:58 AMdb is on GCP postgressql instance
Hafsa Junaid
04/27/2022, 3:58 AMsql private IP is configured correctly
p
Prafulla Mahindrakar
04/27/2022, 4:12 AMHi @Hafsa Junaid did these verification steps run successfully for you from the doc which uses a postgres client .
“Verify connectivity to the DB from the GKE cluster.”
h
Hafsa Junaid
04/28/2022, 8:21 PMHi @Prafulla Mahindrakar What should be the output of that command? I am getting this. For both Public and Private SQL IP.
Hafsa Junaid
04/28/2022, 8:22 PMWhereas I am able to connect to psql with my local system through Public IP
p
Prafulla Mahindrakar
04/29/2022, 2:56 AMHi @Hafsa Junaid the instance should be accessible over the private ip and not the public ip as flyteadmin is not expected to go over the internet to connect to db.
Check if you have configured the private ip correctly for the sql instance .
The test is basically creating a pod on the eks cluster and making sure the eks cluster is able to connect on the private ip
h
Hafsa Junaid
04/29/2022, 3:58 AMThanks, @Prafulla Mahindrakar I am understanding this. At this point in time, the SQL and gke connectivity is successful with Public IP as a host. I have used the same Public IP to deploy helm chart in gcp-values file.
It should work now?
But pods are still failing
p
Prafulla Mahindrakar
04/29/2022, 4:54 AMFor external public IP access I suppose we would need an egress configuration which is not provided with flyte deployment . also it’s a security issue to keep a publically accessible DB. I would suggest first try with private ip to make things work and if you are ok with keeping db publically accessible then we can investigate the egress route.
h
Hafsa Junaid
04/29/2022, 4:58 AMConnection is failing with Private IP.
For now, we can keep it DB public, and will work on security once done with successful deployment.
p
Prafulla Mahindrakar
04/29/2022, 5:04 AMNot a networking expert here but i will have @Haytham Abuelfutuh or someone who has tried such a setup help here.
Currently the deployment guide was produced for Private IP config only
✅ 1
Prafulla Mahindrakar
04/29/2022, 5:15 AMHere is some guide for Private IP available from GCP docs. https://cloud.google.com/sql/docs/postgres/configure-private-ip#console
👍 1
162 Views