acoustic-carpenter-78188
04/08/2026, 9:01 AMread_timeout of the default C10dRendezvousBackend in multi-node trainings with flytekit-kf-pytorch is 60 seconds, which might be too tight, if the zero worker starts slower than any other worker.
To avoid users of flytekit-kf-pytorch being confused by obscure timeout errors during startup of such elastic Pytorch tasks, we add additional hints for configuration that avoid such errors.
What changes were proposed in this pull request?
This PR adds a remark to set explicitly increase the read_timeout of the TCPStore used by the C10dRendezvousBackend, which is the default for multi-node training with flyte-kf-pytorch.
I decided not to change the any defaults in the rdzv_config dictionary to remain agnostic of the chosen backend.
How was this patch tested?
This PR touches only documentation, so no tests are required.
Setup process
Screenshots
Check all the applicable boxes
• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.
Related PRs
Docs link
flyteorg/flytekitacoustic-carpenter-78188
04/08/2026, 9:01 AM