Hello, I have a flyte cluster running in eks with ...
# flyte-deployment
n
Hello, I have a flyte cluster running in eks with all
flyte-*
pods running in
test-flyte
namespace instead of default
flyte
namespace. I am able to create projects and register workflows, but when i try to execute the workflow from the console it goes into an
Unknown
state.
Looking at
flyteadmin
pod’s log: i see its not able to override some value:
Copy code
{"json":{"exec_id":"ahv8j78dp949xztgxgfq"},"level":"warning","msg":"Failed to fetch override values when assigning task resource default values for [resource_type:WORKFLOW project:\"nsaiyed-flyte-project\" domain:\"development\" name:\"<http://workflows.example.wf|workflows.example.wf>\" version:\"v2\" ]: Resource [{Project:nsaiyed-flyte-project Domain:development Workflow:<http://workflows.example.wf|workflows.example.wf> LaunchPlan: ResourceType:TASK_RESOURCE}] not found","ts":"2022-07-11T19:22:12Z"}
{"json":{"exec_id":"ahv8j78dp949xztgxgfq"},"level":"warning","msg":"Failed to fetch override values when assigning execution queue for [{ResourceType:WORKFLOW Project:nsaiyed-flyte-project Domain:development Name:<http://workflows.example.wf|workflows.example.wf> Version:v2 XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}] with err: Resource [{Project:nsaiyed-flyte-project Domain:development Workflow:<http://workflows.example.wf|workflows.example.wf> LaunchPlan: ResourceType:EXECUTION_QUEUE}] not found","ts":"2022-07-11T19:22:12Z"}
{"json":{"exec_id":"ahv8j78dp949xztgxgfq"},"level":"warning","msg":"Setting security context from auth Role","ts":"2022-07-11T19:22:12Z"}
Also, if i look at
flytepropeller
pod’s log i see its not able to find the namespace
flyte
Copy code
1 leaderelection.go:329] error initially creating leader election record: namespaces "flyte" not found
where do i override flytepropeller’s configuration so that it points at the correct namespace i.e.
test-flyte
?
k
hey @Shahwar Saleem you recently deployed flyte in a custom namespace, right? can you share what you had to change
n
we are in the same team, and he is off today 🙂 i am trying to see if anything was missed which is causing this error
k
got it. to answer your original question the "failed to fetch override values" is totally fine, we try and see if overrides exist, and if not, just apply the defaults
y
you can configure that here @Nada Saiyed
s
Hmm, back today. So I think this has to relate to configuration. Some values need to be overridden. I will check my deployment.
227 Views