Eugene Cha
12/27/2021, 2:43 AMKetan (kumare3)
Eugene Cha
12/27/2021, 6:48 AM{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [flyteadmin] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [scheduler] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [remotedata] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [cluster_resources] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [qualityofservice] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [registration] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [notifications] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [domains] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [task_resources] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [secrets] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [storage] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [queues] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [namespace_mapping] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [task_type_whitelist] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [server] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [plugins] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [plugins.catalogcache] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [plugins.k8s] updated. No update handler registered.","ts":"2021-12-27T01:48:57Z"}
Ketan (kumare3)
Prafulla Mahindrakar
12/27/2021, 6:50 AMEugene Cha
12/27/2021, 7:18 AMPrafulla Mahindrakar
12/27/2021, 7:23 AMEugene Cha
12/27/2021, 7:23 AMapiVersion: extensions/v1beta1
kind: Ingress
metadata:
annotations:
<http://alb.ingress.kubernetes.io/actions.ssl-redirect|alb.ingress.kubernetes.io/actions.ssl-redirect>: '{"Type": "redirect", "RedirectConfig":
{ "Protocol": "HTTPS", "Port": "443", "StatusCode": "HTTP_301"}}'
<http://alb.ingress.kubernetes.io/certificate-arn|alb.ingress.kubernetes.io/certificate-arn>: <CERTIFICATE_ARN>
<http://alb.ingress.kubernetes.io/group.name|alb.ingress.kubernetes.io/group.name>: flyte
<http://alb.ingress.kubernetes.io/listen-ports|alb.ingress.kubernetes.io/listen-ports>: '[{"HTTP": 80}, {"HTTPS":443}]'
<http://alb.ingress.kubernetes.io/scheme|alb.ingress.kubernetes.io/scheme>: internet-facing
<http://alb.ingress.kubernetes.io/tags|alb.ingress.kubernetes.io/tags>: service_instance=production
<http://kubernetes.io/ingress.class|kubernetes.io/ingress.class>: nginx
<http://meta.helm.sh/release-name|meta.helm.sh/release-name>: service-flyte-helmchart
<http://meta.helm.sh/release-namespace|meta.helm.sh/release-namespace>: flyte
<http://nginx.ingress.kubernetes.io/app-root|nginx.ingress.kubernetes.io/app-root>: /console
creationTimestamp: "2021-12-27T01:48:25Z"
generation: 1
labels:
<http://app.kubernetes.io/managed-by|app.kubernetes.io/managed-by>: Helm
name: flyte-core
namespace: flyte
resourceVersion: "131147"
selfLink: /apis/extensions/v1beta1/namespaces/flyte/ingresses/flyte-core
uid: 9cc9d62a-6e3d-4808-b98a-815f62408bf8
spec:
rules:
- host: birdejo.live
http:
paths:
- backend:
serviceName: flyteadmin
servicePort: 87
path: /openapi
pathType: ImplementationSpecific
- backend:
serviceName: flyteconsole
servicePort: 80
path: /console
pathType: ImplementationSpecific
- backend:
serviceName: flyteconsole
servicePort: 80
path: /console/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /api
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /api/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /healthcheck
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /v1/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 87
path: /openapi/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /.well-known
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /.well-known/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /login
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /login/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /logout
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /logout/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /callback
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /callback/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /me
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /config
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /config/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /oauth2
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 80
path: /oauth2/*
pathType: ImplementationSpecific
status:
loadBalancer:
ingress:
- hostname: <http://ab4327749f98949d894361022a7d41eb-7d04531a84863ee6.elb.ap-northeast-2.amazonaws.com|ab4327749f98949d894361022a7d41eb-7d04531a84863ee6.elb.ap-northeast-2.amazonaws.com>
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
annotations:
<http://alb.ingress.kubernetes.io/actions.ssl-redirect|alb.ingress.kubernetes.io/actions.ssl-redirect>: '{"Type": "redirect", "RedirectConfig":
{ "Protocol": "HTTPS", "Port": "443", "StatusCode": "HTTP_301"}}'
<http://alb.ingress.kubernetes.io/backend-protocol-version|alb.ingress.kubernetes.io/backend-protocol-version>: HTTP2
<http://alb.ingress.kubernetes.io/certificate-arn|alb.ingress.kubernetes.io/certificate-arn>: <CERTIFICATE_ARN>
<http://alb.ingress.kubernetes.io/group.name|alb.ingress.kubernetes.io/group.name>: flyte
<http://alb.ingress.kubernetes.io/listen-ports|alb.ingress.kubernetes.io/listen-ports>: '[{"HTTP": 80}, {"HTTPS":443}]'
<http://alb.ingress.kubernetes.io/scheme|alb.ingress.kubernetes.io/scheme>: internet-facing
<http://alb.ingress.kubernetes.io/tags|alb.ingress.kubernetes.io/tags>: service_instance=production
<http://kubernetes.io/ingress.class|kubernetes.io/ingress.class>: nginx
<http://meta.helm.sh/release-name|meta.helm.sh/release-name>: service-flyte-helmchart
<http://meta.helm.sh/release-namespace|meta.helm.sh/release-namespace>: flyte
<http://nginx.ingress.kubernetes.io/app-root|nginx.ingress.kubernetes.io/app-root>: /console
<http://nginx.ingress.kubernetes.io/backend-protocol|nginx.ingress.kubernetes.io/backend-protocol>: GRPC
creationTimestamp: "2021-12-27T01:48:25Z"
generation: 1
labels:
<http://app.kubernetes.io/managed-by|app.kubernetes.io/managed-by>: Helm
name: flyte-core-grpc
namespace: flyte
resourceVersion: "131146"
selfLink: /apis/extensions/v1beta1/namespaces/flyte/ingresses/flyte-core-grpc
uid: 5512ef0b-eb59-41bd-a1f8-f45b9dfad290
spec:
rules:
- host: birdejo.live
http:
paths:
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.AdminService
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.AdminService/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.AuthMetadataService
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.AuthMetadataService/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.IdentityService
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /flyteidl.service.IdentityService/*
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /grpc.health.v1.Health
pathType: ImplementationSpecific
- backend:
serviceName: flyteadmin
servicePort: 81
path: /grpc.health.v1.Health/*
pathType: ImplementationSpecific
status:
loadBalancer:
ingress:
- hostname: <http://ab4327749f98949d894361022a7d41eb-7d04531a84863ee6.elb.ap-northeast-2.amazonaws.com|ab4327749f98949d894361022a7d41eb-7d04531a84863ee6.elb.ap-northeast-2.amazonaws.com>
Yuvraj
12/27/2021, 7:25 AMdelegate: true
and then re run the opta ? https://github.com/flyteorg/flyte/blob/master/opta/aws/env.yaml#L11Eugene Cha
12/27/2021, 7:26 AMYuvraj
12/27/2021, 7:30 AM<http://alb.ingress.kubernetes.io/certificate-arn|alb.ingress.kubernetes.io/certificate-arn>: <CERTIFICATE_ARN>
Prafulla Mahindrakar
12/27/2021, 7:32 AMYuvraj
12/27/2021, 7:34 AMEugene Cha
12/27/2021, 7:36 AMPrafulla Mahindrakar
12/27/2021, 7:37 AMkubectl get service -n flyte
Eugene Cha
12/27/2021, 7:43 AMPrafulla Mahindrakar
12/27/2021, 7:43 AMadmin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: <uuid>.<http://us-east-2.elb.amazonaws.com:81|us-east-2.elb.amazonaws.com:81>
authType: Pkce
insecure: true
Eugene Cha
12/27/2021, 9:35 AMPrafulla Mahindrakar
12/27/2021, 9:36 AMEugene Cha
12/27/2021, 9:37 AMYuvraj
12/27/2021, 3:16 PMflytectl config init --host <uuid>.<http://us-east-2.elb.amazonaws.com:81|us-east-2.elb.amazonaws.com:81> --insecure
Prafulla Mahindrakar
12/28/2021, 6:25 AMEugene Cha
12/28/2021, 2:42 PMNAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
datacatalog LoadBalancer 172.20.54.245 <http://ac48efd29e98942b4aa4a430ead8cb9e-923941080.ap-northeast-2.elb.amazonaws.com|ac48efd29e98942b4aa4a430ead8cb9e-923941080.ap-northeast-2.elb.amazonaws.com> 8089:32568/TCP,88:31929/TCP,89:31078/TCP 36h
flyte-pod-webhook ClusterIP 172.20.236.53 <none> 443/TCP 36h
flyteadmin LoadBalancer 172.20.163.192 <http://ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com|ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com> 80:32626/TCP,81:30177/TCP,87:31898/TCP,10254:32737/TCP 36h
flyteconsole LoadBalancer 172.20.157.1 <http://a31945de8f10c440a85b8b3491ced10a-1691719649.ap-northeast-2.elb.amazonaws.com|a31945de8f10c440a85b8b3491ced10a-1691719649.ap-northeast-2.elb.amazonaws.com> 80:32150/TCP 36h
This is what I get when I put the flyteadmin url in config
❯ flytectl config init --host <http://ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com:81|ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com:81> --insecure
INFO[0000] [0] Couldn't find a config file []. Relying on env vars and pflags.
{"json":{},"level":"error","msg":"failed to initialize token source provider. Err: failed to fetch auth metadata. Error: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: missing address\"","ts":"2021-12-28T23:37:58+09:00"}
{"json":{},"level":"warning","msg":"Starting an unauthenticated client because: can't create authenticated channel without a TokenSourceProvider","ts":"2021-12-28T23:37:58+09:00"}
{"json":{},"level":"info","msg":"Initialized Admin client","ts":"2021-12-28T23:37:58+09:00"}
Error: Please use a valid endpoint
{"json":{},"level":"error","msg":"Please use a valid endpoint","ts":"2021-12-28T23:37:58+09:00"}
Yuvraj
12/28/2021, 3:05 PM20:30:48 ➜ cookbook flytectl config init --host='<http://ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com:81|ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com:81>' --insecure
This action will overwrite an existing config file at [/Users/yuvraj/.flyte/config.yaml]. Do you want to continue? [y/n]: y
Init flytectl config file at [/Users/yuvraj/.flyte/config.yaml]% 20:31:46 ➜ cookbook flytectl get projects
--------------- --------------- ---------------------------
| ID | NAME | DESCRIPTION |
--------------- --------------- ---------------------------
| flyteexamples | flyteexamples | flyteexamples description |
--------------- --------------- ---------------------------
| flytetester | flytetester | flytetester description |
--------------- --------------- ---------------------------
| flytesnacks | flytesnacks | flytesnacks description |
--------------- --------------- ---------------------------
3 rows
In config command we added the validation recently and it's a bug, I will create a fix for that, For now you can use this config for validation ~/.flyte/config.yaml
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: dns:///ae7fc964d0d1b498fb0d955e9d0f5977-80905779.ap-northeast-2.elb.amazonaws.com:81
authType: Pkce
insecure: true
logger:
show-source: true
level: 0
Eugene Cha
12/28/2021, 3:14 PMYuvraj
12/28/2021, 3:15 PM~/.flyte/config.yaml
Eugene Cha
12/28/2021, 3:15 PMYuvraj
12/28/2021, 3:15 PMEugene Cha
12/28/2021, 3:16 PMYuvraj
12/28/2021, 3:18 PMEugene Cha
12/28/2021, 3:18 PMYuvraj
12/28/2021, 3:18 PMflytectl get projects
Eugene Cha
12/28/2021, 3:19 PMYuvraj
12/28/2021, 3:19 PMEugene Cha
12/28/2021, 3:19 PMYuvraj
12/28/2021, 3:30 PMEugene Cha
12/28/2021, 3:30 PMYuvraj
12/28/2021, 3:33 PMKetan (kumare3)
Eugene Cha
12/28/2021, 3:34 PMYuvraj
12/28/2021, 3:35 PMEugene Cha
12/28/2021, 3:35 PMPrafulla Mahindrakar
12/29/2021, 4:53 AMKetan (kumare3)
Eugene Cha
12/29/2021, 7:25 AMPrafulla Mahindrakar
12/29/2021, 7:26 AMEugene Cha
12/30/2021, 8:36 AMPrafulla Mahindrakar
12/30/2021, 8:44 AMEugene Cha
12/30/2021, 8:57 AM