I’m running some workflows with dynamic tasks that...
# ask-the-community
g
I’m running some workflows with dynamic tasks that fan out to a few hundred nodes and trying to get back the node statuses via
Copy code
remote.sync(execution, sync_nodes=True)
It seems that a gRPC call is made to sync the status for every node, resulting in a few hundred calls. This makes the workflow execution take very long to sync. Any suggestions on speeding this up e.g. batch fetch the node executions or limit the recursive depth of syncing nodes?
s
cc @Yee @Eduardo Apolinario (eapolinario)
e
that's a reasonable feature. @Gerry Meixiong, can you create a gh issue?
150 Views