tim leonard
04/19/2023, 11:42 PMvalidate download
fails. This usually can be resolved by retrying the download. Is there any way to have a workflow retrigger itself in flyte? Basically if I see an error on validate download
can i just restart the workflow?Greg Gydush
04/19/2023, 11:46 PMKetan (kumare3)
04/20/2023, 4:04 AMurl = get_url
while True:
try:
download(url)
validate(url)
return True
except:
pass
tim leonard
04/20/2023, 3:48 PMFlyteRecoverableException
looks like what I need. I can throw that, and then set @task(retries=10)
so that it retries.
Ketan - that solution would work fine within a task, but my download and validate fns are flyte tasks themselves. Would the while true: try
structure work in a workflow? I haven't tried that.Ketan (kumare3)
04/20/2023, 7:38 PM