seunggs

    seunggs

    23 hours ago
    {
      project: "shelly-robotics-bidepal-robot",
      domain: "development",
      name: "my-project.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1",
      spec: {
        launch_plan: {
          project: "shelly-robotics-bidepal-robot",
          domain: "development",
          name: "my-project.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1",
          version: "0.0.1",
        },
        inputs: {
          x: 1,
        },
      },
    };
    Yee

    Yee

    23 hours ago
    do you have any more errors?
    any stack traces/line numbers etc. would be helpful
    seunggs

    seunggs

    23 hours ago
    This is all I got (it’s the response I get from the browser when I hit the /executions endpoint):
    {
      "error": "size of name exceeded length 20 : my_project.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1",
      "code": 3,
      "message": "size of name exceeded length 20 : my_project.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1"
    }
    Exact same workflow seems to work fine when I execute it from the dashboard ui so it looks like flyte’s rest api validation?
    Yee

    Yee

    22 hours ago
    can you check admin logs to see if there’s any more information?
    seunggs

    seunggs

    22 hours ago
    So flyteadmin pod logs?
    Yee

    Yee

    22 hours ago
    yeah
    seunggs

    seunggs

    22 hours ago
    I think these are it:
    2022/09/23 23:13:39 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:103
    [1.064ms] [rows:9] SELECT "executions"."id","executions"."created_at","executions"."updated_at","executions"."deleted_at","executions"."execution_project","executions"."execution_domain","executions"."execution_name","executions"."launch_plan_id","executions"."workflow_id","executions"."task_id","executions"."phase","executions"."closure","executions"."spec","executions"."started_at","executions"."execution_created_at","executions"."execution_updated_at","executions"."duration","executions"."abort_cause","executions"."mode","executions"."source_execution_id","executions"."parent_node_execution_id","executions"."cluster","executions"."inputs_uri","executions"."user_inputs_uri","executions"."error_kind","executions"."error_code","executions"."user","executions"."state" FROM "executions" INNER JOIN workflows ON executions.workflow_id = workflows.id WHERE executions.execution_project = 'shelly-robotics-bipedal-robot' AND executions.execution_domain = 'development' AND (workflows.name = 'sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1') AND executions.state = 'EXECUTION_ACTIVE' ORDER BY created_at desc LIMIT 100
    
    2022/09/23 23:13:39 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/workflow_repo.go:44 record not found
    [1.267ms] [rows:0] SELECT * FROM "workflows" WHERE "workflows"."project" = 'shelly-robotics-bipedal-robot' AND "workflows"."domain" = 'development' AND "workflows"."name" = 'sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1' AND "workflows"."version" = 'draft' LIMIT 1
    {"json":{"src":"workflow_manager.go:222","wf":"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1"},"level":"info","msg":"Failed to get workflow with id [resource_type:WORKFLOW project:\"shelly-robotics-bipedal-robot\" domain:\"development\" name:\"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1\" version:\"draft\" ] with err missing entity of type WORKFLOW with identifier project:\"shelly-robotics-bipedal-robot\" domain:\"development\" name:\"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1\" version:\"draft\" ","ts":"2022-09-23T23:13:39Z"}
    {"json":{"src":"workflow.go:43"},"level":"info","msg":"Adding resource type for unspecified value in request: [id:\u003cproject:\"shelly-robotics-bipedal-robot\" domain:\"development\" name:\"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1\" version:\"0.0.18\" \u003e ]","ts":"2022-09-23T23:13:40Z"}
    
    2022/09/23 23:13:40 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/workflow_repo.go:44
    [0.571ms] [rows:1] SELECT * FROM "workflows" WHERE "workflows"."project" = 'shelly-robotics-bipedal-robot' AND "workflows"."domain" = 'development' AND "workflows"."name" = 'sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1' AND "workflows"."version" = '0.0.18' LIMIT 1
    {"json":{"src":"execution_manager.go:818"},"level":"debug","msg":"Failed to validate ExecutionCreateRequest {Project:shelly-robotics-bipedal-robot Domain:development Name:sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1 Spec:launch_plan:\u003cproject:\"shelly-robotics-bipedal-robot\" domain:\"development\" name:\"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1\" version:\"0.0.18\" \u003e inputs:\u003c\u003e security_context:\u003crun_as:\u003ck8s_service_account:\"flyte-executor\" \u003e \u003e  Inputs: XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} with err size of name exceeded length 20 : sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1","ts":"2022-09-23T23:13:44Z"}
    
    2022/09/23 23:13:44 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:103
    [1.265ms] [rows:9] SELECT "executions"."id","executions"."created_at","executions"."updated_at","executions"."deleted_at","executions"."execution_project","executions"."execution_domain","executions"."execution_name","executions"."launch_plan_id","executions"."workflow_id","executions"."task_id","executions"."phase","executions"."closure","executions"."spec","executions"."started_at","executions"."execution_created_at","executions"."execution_updated_at","executions"."duration","executions"."abort_cause","executions"."mode","executions"."source_execution_id","executions"."parent_node_execution_id","executions"."cluster","executions"."inputs_uri","executions"."user_inputs_uri","executions"."error_kind","executions"."error_code","executions"."user","executions"."state" FROM "executions" INNER JOIN workflows ON executions.workflow_id = workflows.id WHERE executions.execution_project = 'shelly-robotics-bipedal-robot' AND executions.execution_domain = 'development' AND (workflows.name = 'sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1') AND executions.state = 'EXECUTION_ACTIVE' ORDER BY created_at desc LIMIT 100
    Yee

    Yee

    22 hours ago
    that’s it?
    seunggs

    seunggs

    22 hours ago
    Based on the timestamp these are generated when I hit the /executions endpoint
    There’s a lot more but I think that’s from before
    Yee

    Yee

    22 hours ago
    kubectl -n flyte logs <pod> | egrep -B 2 -A 2 "size of name"
    does that give anything?
    seunggs

    seunggs

    22 hours ago
    Yes:
    2022/09/23 23:13:40 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/workflow_repo.go:44
    [0.571ms] [rows:1] SELECT * FROM "workflows" WHERE "workflows"."project" = 'shelly-robotics-bipedal-robot' AND "workflows"."domain" = 'development' AND "workflows"."name" = 'sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1' AND "workflows"."version" = '0.0.18' LIMIT 1
    {"json":{"src":"execution_manager.go:818"},"level":"debug","msg":"Failed to validate ExecutionCreateRequest {Project:shelly-robotics-bipedal-robot Domain:development Name:sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1 Spec:launch_plan:\u003cproject:\"shelly-robotics-bipedal-robot\" domain:\"development\" name:\"sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1\" version:\"0.0.18\" \u003e inputs:\u003c\u003e security_context:\u003crun_as:\u003ck8s_service_account:\"flyte-executor\" \u003e \u003e  Inputs: XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} with err size of name exceeded length 20 : sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1","ts":"2022-09-23T23:13:44Z"}
    
    2022/09/23 23:13:44 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:103
    So it looks like this is the error:
    Inputs: XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} with err size of name exceeded length 20 : sidetrek_generated.workflows.04b2ed0b-434b-4d7b-9220-90606fdc2afc.test_wf_1
    Also looks like my inputs field format might be wrong?
    Kevin Su

    Kevin Su

    16 hours ago
    seunggs

    seunggs

    6 hours ago
    Thanks @Kevin Su ! But I thought I were using the latest helm chart already (v1.2.0-b3)? Not sure which helm version is linked to this flyteadmin version?
    Kevin Su

    Kevin Su

    5 hours ago
    seunggs

    seunggs

    1 hour ago
    OK thanks - but I do have automation setup so just to confirm, this is not released in the helm chart yet?
    Kevin Su

    Kevin Su

    44 minutes ago
    yes, but we’ll release v1.2.0 soon, and it will include that patch.