Is there any way to configure retries in flytekit ...
# flyte-supportc
clean-glass-36808
10/07/2025, 8:02 PMIs there any way to configure retries in flytekit for metadata operations? We have some transient DNS failures we'd like to see if we can retry on (in addition to retrying system level failures in propeller when the task gives up).
clean-glass-36808
10/07/2025, 8:04 PMclean-glass-36808
10/07/2025, 8:37 PMLooks like it only handles rate limiting.. I guess we'll fork it and make it work for us
f
freezing-airport-6809
10/07/2025, 9:33 PM
Why fork
freezing-airport-6809
10/07/2025, 9:33 PM
Is it s3 compliant
freezing-airport-6809
10/07/2025, 9:33 PM
You can have env vars
c
clean-glass-36808
10/07/2025, 9:35 PMAre you suggesting to make the behavior configurable through environment variables? Or are there some environment variables that already support this that we don't know about?
clean-glass-36808
10/07/2025, 9:39 PMLooks like fsspec has some storage options with built in retries that may handle DNS failures
f
freezing-airport-6809
10/07/2025, 9:39 PM
Yup and AWS cars already supported
c
clean-glass-36808
10/07/2025, 10:29 PMLooks like the defaults should be handling our DNS resolution failures and they already retry 5x ☠️
g
glamorous-carpet-83516
10/08/2025, 4:20 AMyup, maybe you can contribute to fsspec
3 Views