Hi there! I'm just discovering flyte and have question regarding pipelines, which I didn't find the answer to yet:
Is it possible to achieve this:
• Task A
◦ checks external source periodically for updates
◦ if external source changes, provide different outputs
◦ invalidate all produced artifacts (e.g. checkpoints, metrics, ...) of the whole pipeline
• Task B (depends on Task A)
◦ restart when Task A changes its outputs
The use-case would be that a user changes the training-configuration and thus the training has to be restarted. Also, all produced checkpoints should be invalidated.