hallowed-doctor-67759
02/14/2023, 4:58 PMhallowed-doctor-67759
02/14/2023, 4:59 PMsync-cluster-resources
init container is
panic: unable to load root certificates: unable to parse bytes as PEM block
goroutine 1 [running]:
main.main()
/go/src/github.com/flyteorg/flyteadmin/cmd/main.go:13 +0x91
hallowed-doctor-67759
02/14/2023, 5:03 PMhallowed-doctor-67759
02/14/2023, 5:05 PMvalues-override.yaml
file, it uses this config:
flyteadmin:
additionalVolumes:
- name: cluster-credentials
secret:
secretName: cluster-credentials
additionalVolumeMounts:
- name: cluster-credentials
mountPath: /var/run/credentials
but additionalVolumeMounts
will only mount to the main container. so sync-cluster-resources
isnβt getting the cluster credentials file mounted in the current chart. Thatβs an easy fix and so now Iβm stuck at the PEM error.hallowed-doctor-67759
02/14/2023, 5:06 PMhallowed-doctor-67759
02/14/2023, 5:09 PMhallowed-doctor-67759
02/14/2023, 5:42 PMflyteadmin-token
(starting with data plane in the same cluster before adding a second cluster) and the PEM block error went away.hallowed-doctor-67759
02/14/2023, 5:45 PMhallowed-doctor-67759
02/14/2023, 5:47 PM{
"cacert": "-----BEGIN CERTIFICATE-----\n...\n-----END CERTIFICATE-----\n",
"token": "..."
}
freezing-airport-6809
freezing-airport-6809
hallowed-doctor-67759
02/15/2023, 4:35 AMflytectl
right now due to some mysterious grpc errors:
Error: Connection Info: [Endpoint: dns:///..., InsecureConnection?: false, AuthMode: Pkce]: rpc error: code = Unknown desc = unexpected HTTP status code received from server: 464 (); malformed header: missing HTTP content-type
Error: Connection Info: [Endpoint: dns:///..., InsecureConnection?: true, AuthMode: Pkce]: rpc error: code = Unavailable desc = connection closed before server preface received
Not sure what Iβm going to do since the docs make it seem easy and itβs just not working. I might try the simple flyte setup and then abandon it if flytectl
still doesnβt work. It worked ~1 month ago but no longer.hallowed-doctor-67759
02/15/2023, 4:52 AMflytectl
still not working with the simple binary deployment and port-forwarding just like in the deployment docs.
β°ββ― flytectl get projects
Error: Connection Info: [Endpoint: dns:///localhost:8088, InsecureConnection?: true, AuthMode: Pkce]: rpc error: code = Unavailable desc = connection closed before server preface received
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
hallowed-doctor-67759
02/15/2023, 5:10 AMββ― kubectl -n flyte port-forward service/flyte-backend-flyte-binary 8088:8088 8089:8089
Forwarding from 127.0.0.1:8088 -> 8088
Forwarding from [::1]:8088 -> 8088
Forwarding from 127.0.0.1:8089 -> 8089
Forwarding from [::1]:8089 -> 8089
Handling connection for 8088
hallowed-doctor-67759
02/15/2023, 5:11 AMhallowed-doctor-67759
02/15/2023, 5:12 AMflyte-core
deploymentfreezing-airport-6809
freezing-airport-6809
hallowed-doctor-67759
02/15/2023, 5:13 AMfreezing-airport-6809
freezing-airport-6809
hallowed-doctor-67759
02/15/2023, 5:15 AM--insecure
and hadnβt discovered that yet:
β°ββ― flytectl config init --host localhost:8089
This action will overwrite an existing config file at [/Users/alexifm/.flyte/config.yaml]. Do you want to continue? [y/n]: y
Init flytectl config file at [/Users/alexifm/.flyte/config.yaml]%
β°ββ― flytectl get projects
Error: Connection Info: [Endpoint: dns:///localhost:8089, InsecureConnection?: false, AuthMode: Pkce]: rpc error: code = Unavailable desc = connection error: desc = "transport: authentication handshake failed: tls: first record does not look like a TLS handshake"
hallowed-doctor-67759
02/15/2023, 5:16 AMFlyte-core is not single binary and port forwarding will jot work for Uiright, I got the ingress working and can visit the console via our DNS name but the connection to GRPC via flytectl wasnβt working
hallowed-doctor-67759
02/15/2023, 6:51 AMkubefwd
to get flytectl
working since DNS isnβt.
β°ββ― sudo -E kubefwd svc -n flyte -f metadata.name=flyteadmin
β°ββ― cat /etc/hosts
ββββββββ¬ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β File: /etc/hosts
ββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
...
12 β 127.1.27.1 flyteadmin flyteadmin.flyte flyteadmin-flyte flyteadmin.flyte.svc flyteadmin-flyte-svc flytead
β min.flyte.svc.cluster.local flyteadmin-flyte-svc-cluster-local flyteadmin.flyte.infima-staging-eks flyteadmin-f
β lyte-infima-staging-eks flyteadmin.flyte.svc.infima-staging-eks flyteadmin-flyte-svc-infima-staging-eks flytead
β min.flyte.svc.cluster.infima-staging-eks flyteadmin-flyte-svc-cluster-infima-staging-eks
ββββββββ΄ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β°ββ― flytectl config init --host flyteadmin:81 --insecure
hallowed-doctor-67759
02/15/2023, 7:48 PMflytectl
is due to the ingress controller not supporting GRPC. π€· Weβre going to switch back to the original setup we used from the old version of the docs.freezing-airport-6809
freezing-airport-6809
thankful-minister-83577
thankful-minister-83577
hallowed-doctor-67759
02/15/2023, 7:59 PM