Vishal Dumont09/15/2023, 3:55 PM
This would be similar to
If I have one workflow(A) that has three sub workflows(X, Y, Z). - Y depends on X - Z depends on Y Essentially, X -> Y -> Z Let's assume X, Y & Z were successful. However, subworkflow Y had generated bad data i.e. has bugs and needs to be re-run. My goal is to re-run Y and it's downstreams i.e. want Z to pick up the latest partitions of Y.
option in Airflow. Does something like this exist in Flyte? I looked at recover, but this only seems to be for Failed tasks.
Vishal Dumont09/15/2023, 5:15 PM
Vishal Dumont09/18/2023, 1:03 PM
Vishal Dumont09/18/2023, 1:59 PM
I guess you could run one task and (single task) and then run the entire workflowFor the above, you're hoping running a single task invalidates the subsequent tasks as well, right? And when I re-run the workflow, it should run all the downstreams as well?