I’m running some workflows with dynamic tasks that fan out to a few hundred nodes and trying to get back the node statuses via
Copy code
remote.sync(execution, sync_nodes=True)
It seems that a gRPC call is made to sync the status for every node, resulting in a few hundred calls. This makes the workflow execution take very long to sync. Any suggestions on speeding this up e.g. batch fetch the node executions or limit the recursive depth of syncing nodes?
t
tall-lock-23197
05/08/2023, 5:10 AM
cc @thankful-minister-83577@high-accountant-32689
h
high-accountant-32689
05/08/2023, 7:22 PM
that's a reasonable feature. @lively-engineer-47231, can you create a gh issue?