Hello, I’m trying to install flyte cluster in exis...
# ask-the-community
a
Hello, I’m trying to install flyte cluster in existing EKS using instruction in https://docs.flyte.org/en/v1.0.0/deployment/aws/manual.html but I found one of the pod failed to start kubectl -n flyte get pod NAME READY STATUS RESTARTS AGE datacatalog-86f5c9c887-9l4lc 1/1 Running 0 23m datacatalog-86f5c9c887-ldcn6 1/1 Running 0 23m flyte-pod-webhook-5c67fbfb8c-v4sxc 1/1 Running 0 23m flyteadmin-66996975b9-5l9tm 1/1 Running 0 23m flyteadmin-66996975b9-sr45q 1/1 Running 0 23m flyteconsole-757c979578-97rbr 1/1 Running 0 23m flyteconsole-757c979578-s965v 1/1 Running 0 23m flytepropeller-7bcb7fc885-rpht9 0/1 CrashLoopBackOff 9 (2m1s ago) 23m flytescheduler-985cd58f5-2pqq5 1/1 Running 0 23m syncresources-86dd57b889-xr5w2 1/1 Running 0 23m in the log of pod: kubectl -n flyte logs flytepropeller-7bcb7fc885-rpht9 time=“2023-06-30T122505Z” level=info msg=------------------------------------------------------------------------ time=“2023-06-30T122505Z” level=info msg=“App [flytepropeller], Version [unknown], BuildSHA [unknown], BuildTS [2023-06-30 122505.883856281 +0000 UTC m=+0.048754070]” time=“2023-06-30T122505Z” level=info msg=------------------------------------------------------------------------ time=“2023-06-30T122505Z” level=info msg=“Detected: 4 CPU’s\n” {“json”{},“level”“warning”,“msg”:“defaulting max ttl for workflows to 23 hours, since configured duration is larger than 23 [23]“,”ts”“2023 06 30T1225:06Z”} {“json”{},“level”“warning”,“msg”:“stow configuration section missing, defaulting to legacy s3/minio connection config”,“ts”“2023 06 30T1225:06Z”} I0630 122506.541469 1 leaderelection.go:248] attempting to acquire leader lease flyte/propeller-leader... I0630 122506.571316 1 leaderelection.go:258] successfully acquired lease flyte/propeller-leader {“json”{},“level”“error”,“msg”:“Cannot set default plugin [agent-service] for task types [[bigquery_query_job_task]] when it is not configured to be an enabled plugin. Please double check the flytepropeller config.“,”ts”“2023 06 30T1225:06Z”} {“json”{},“level”“error”,“msg”:“Failed to finalize enabled plugins. Error: cannot set default plugin [agent-service] for task types [[bigquery_query_job_task]] when it is not configured to be an enabled plugin”,“ts”“2023 06 30T1225:06Z”} {“json”{},“level”“panic”,“msg”:“cannot set default plugin [agent-service] for task types [[bigquery_query_job_task]] when it is not configured to be an enabled plugin”,“ts”“2023 06 30T1225:06Z”} panic: (*logrus.Entry) 0xc0008b4850
how can I resolve the pod issue ? thank you
d
Hi @Anthony Seems to be complaining about the agent-service Check your values file, for
flyte-core
there's a
enabled_plugins
section where
- agent-service
should be present
a
Hi @David Espejo (he/him) I can’t find flyte-core section in values file but is it related to below section ? flytepropeller: plugins: enabled: - agent-service replicaCount: 1 manager: false #manager: true serviceAccount: # -- If the service account is created by you, make this false create: true annotations: eks.amazonaws.com/role-arn: arnawsiam::{{ .Values.userSettings.accountNumber }}:role/iam-role-flyte resources: limits: cpu: 1 ephemeral-storage: 1Gi memory: 2Gi requests: cpu: 1 ephemeral-storage: 1Gi memory: 2Gi cacheSizeMbs: 1024 # -- Sets priorityClassName for propeller pod(s). priorityClassName: “system-cluster-critical” affinity: podAntiAffinity: requiredDuringSchedulingIgnoredDuringExecution: - labelSelector: matchLabels: app.kubernetes.io/name: flytepropeller topologyKey: kubernetes.io/hostname # # FLYTE_AGENT # flyteagent: enabled: false
d
a
checked, it should be presented helm show values flyteorg/flyte-core enabled_plugins: # -- Tasks specific configuration [structure](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/contr tasks: # -- Plugins configuration, [structure](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controlle task-plugins: # -- [Enabled Plugins](https://pkg.go.dev/github.com/lyft/flyteplugins/go/tasks/config#Config). Enable sa # plugins enabled-plugins: - container - sidecar - k8s-array - agent-service default-for-task-types: container: container sidecar: sidecar container_array: k8s-array bigquery_query_job_task: agent-service
d
also, you could consider deploying the single binary using this community-maintained guide: https://github.com/davidmirror-ops/flyte-the-hard-way
147 Views