https://flyte.org logo
#ask-the-community
Title
# ask-the-community
g

Gerry Meixiong

05/05/2023, 6:11 PM
I’m running some workflows with dynamic tasks that fan out to a few hundred nodes and trying to get back the node statuses via
Copy code
remote.sync(execution, sync_nodes=True)
It seems that a gRPC call is made to sync the status for every node, resulting in a few hundred calls. This makes the workflow execution take very long to sync. Any suggestions on speeding this up e.g. batch fetch the node executions or limit the recursive depth of syncing nodes?
s

Samhita Alla

05/08/2023, 5:10 AM
cc @Yee @Eduardo Apolinario (eapolinario)
e

Eduardo Apolinario (eapolinario)

05/08/2023, 7:22 PM
that's a reasonable feature. @Gerry Meixiong, can you create a gh issue?