Hello everyone. previously, I asked a question abo...
# flyte-support
c
Hello everyone. previously, I asked a question about creating a master workflow, similar to airflow (child >> parent). If there are 1000 workflow objects, everything works, even though it takes a very long time to assemble. but when I try to do 5000+ workflow I get a strange error. I don't understand why it occurs.
Copy code
dependencies = get_workflow_dependencies()
 
 wf_t = ImperativeWorkflow(name="root-workflow")  # , failure_policy=failure_policy
 
 node_dic = {}
 
 for parent, child in dependencies:
     if parent!=child:
         if parent not in node_dic:
             parent_module = importlib.import_module(f'workflows.{parent}')
             parent_wf=getattr(parent_module, 'wf_test')
             parent_launch_plan = LaunchPlan.get_or_create(
                 parent_wf, parent
             )
             node_dic[parent] = wf_t.add_launch_plan(parent_launch_plan)
 
         if child not in node_dic:
             child_module = importlib.import_module(f'workflows.{child}') 
             child_wf=getattr(child_module, 'wf_test')
             parent_launch_plan = LaunchPlan.get_or_create(
                 child_wf, child
             )
             node_dic[child] = wf_t.add_launch_plan(parent_launch_plan)
 
                 # child_node = child_node.with_overrides(
                 #     name=f"b-{child}"
                 # )
 
         node_dic[parent].runs_before(node_dic[child])
h
Very interesting, @calm-soccer-24586. Can you give us more details? For example, is this running single-binary? Which version? Also, do you see anything in the logs?
c
I am using help charts flyte-binary, the latest version. I tried to find other logs, but apparently there are none. I'm running the master workflow via pyflyte. apparently, this error is related to the number of sub workflows.
@high-accountant-32689 Error: Connection Info: [Endpoint: dns///flyte.k8s.arch dev 8.salt.x5.ru80, InsecureConnection?: true, AuthMode: ClientSecret]: rpc error: code = Unknown desc = unexpected HTTP status code received from server: 413 (Request Entity Too Large); transport: received unexpected content-type "text/html" {"json":{},"level":"error","msg":"Connection Info: [Endpoint: dns///flyte.k8s.arch dev 8.salt.x5.ru80, InsecureConnection?: true, AuthMode: ClientSecret]: rpc error: code = Unknown desc = unexpected HTTP status code received from server: 413 (Request Entity Too Large); transport: received unexpected content-type \"text/html\"","ts":"2024-12-27T151840+03:00"}
a
hey @calm-soccer-24586 sorry for the delays looking at the error message seems like you may benefit from offloading the workflow definitions to blob storage https://docs.flyte.org/en/latest/deployment/configuration/performance.html#offloading-static-workflow-information-from-crd Does that makes sense for your use case?