Hello 🙂 I'm currently trying to set up flyte 1.3.0 on AWS EKS 1.27 (our current flyte setup is running on 1.23). I haven't done any other changes beside the k8s update and am running into below errors/warnings from the flyte admin while trying to create a workflow. I'm wondering if I oversaw any k8s version limitations from the flyte perspective or something else.

{"json":{"x-request-id":"a-nkqkn6ckxxcjrxc45ftj"},"level":"warning","msg":"Failed to fetch override values when assigning task resource default values for [resource_type:TASK project:\"broder\" domain:\"development\" name:\"src.loading.get_data.load_sample_data\" version:\"fUkU2IwuEUHd25UVHD5tFQ==\" ]: Resource [{Project:broder Domain:development Workflow: LaunchPlan: ResourceType:TASK_RESOURCE}] not found","ts":"2023-09-29T07:34:20Z"}
{"json":{"x-request-id":"a-gv9hhtk7jrgbskmkqngn"},"level":"warning","msg":"Failed to fetch override values when assigning task resource default values for [resource_type:TASK project:\"broder\" domain:\"development\" name:\"src.preprocessing.filter.filter_for_job\" version:\"fUkU2IwuEUHd25UVHD5tFQ==\" ]: Resource [{Project:broder Domain:development Workflow: LaunchPlan: ResourceType:TASK_RESOURCE}] not found","ts":"2023-09-29T07:34:20Z"}
{"json":{"x-request-id":"a-dm2qmntbpqjzzd4v2gjh"},"level":"warning","msg":"Failed to fetch override values when assigning task resource default values for [resource_type:TASK project:\"broder\" domain:\"development\" name:\"src.loading.output_result.output_result\" version:\"fUkU2IwuEUHd25UVHD5tFQ==\" ]: Resource [{Project:broder Domain:development Workflow: LaunchPlan: ResourceType:TASK_RESOURCE}] not found","ts":"2023-09-29T07:34:20Z"}
{"json":{"exec_id":"f86447f1c7fb94aa2b60","x-request-id":"a-dt254dxgs9vpnnqzjnvh"},"level":"warning","msg":"Failed to fetch override values when assigning task resource default values for [resource_type:WORKFLOW project:\"broder\" domain:\"development\" name:\"use_case_workflow.sample_workflow\" version:\"fUkU2IwuEUHd25UVHD5tFQ==\" ]: Resource [{Project:broder Domain:development Workflow:use_case_workflow.sample_workflow LaunchPlan: ResourceType:TASK_RESOURCE}] not found","ts":"2023-09-29T07:34:21Z"}
{"json":{"exec_id":"f86447f1c7fb94aa2b60","x-request-id":"a-dt254dxgs9vpnnqzjnvh"},"level":"warning","msg":"Failed to fetch override values when assigning execution queue for [{ResourceType:WORKFLOW Project:broder Domain:development Name:use_case_workflow.sample_workflow Version:fUkU2IwuEUHd25UVHD5tFQ== XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}] with err: Resource [{Project:broder Domain:development Workflow:use_case_workflow.sample_workflow LaunchPlan: ResourceType:EXECUTION_QUEUE}] not found","ts":"2023-09-29T07:34:21Z"}
{"json":{"exec_id":"f86447f1c7fb94aa2b60","x-request-id":"a-dt254dxgs9vpnnqzjnvh"},"level":"warning","msg":"Setting security context from auth Role","ts":"2023-09-29T07:34:21Z

Error from `pyflyte run`:

grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
        status = StatusCode.INTERNAL
        details = "failed to create workflow in propeller the server could not find the requested resource (post <http://flyteworkflows.flyte.lyft.com|flyteworkflows.flyte.lyft.com>)"
        debug_error_string = "UNKNOWN:Error received from peer  {grpc_message:"failed to create workflow in propeller the server could not find the requested resource (post <http://flyteworkflows.flyte.lyft.com|flyteworkflows.flyte.lyft.com>)", grpc_status:13, created_time:"2023-09-29T09:34:21.458589715+02:00"}"

The CRD exists on the data plane.

Why so old

Do you mean the flyte or k8s version? ^^

Flyte

The usual: time and priority to to updates 🤷 Is there a definite connection to the issue? Should I just try a more recent version?