David Espejo (he/him)09/08/2023, 9:07 PM
David Espejo (he/him)09/11/2023, 6:22 PM
. “max-cache-age” defines when Flyte will stop using the values but, if there are cached outputs in object storage that need to be lifecycled, that needs be taken care of by bucket lifecycling policies - you don’t get that OOB with Flyte. One way to cleanup might be to set
to 7d, and lifecycle objects in your bucket after 14 days. cc @Hema Jayachandran 3. We can trigger Runs by CRONS, but can we Run a Workflow when another one finishes ? a. You can achieve this by chaninig workflows using the
operator. Docs:https://docs.flyte.org/projects/cookbook/en/latest/auto_examples/advanced_composition/chain_entities.html 4. is it sensible to poll an external service in a workflow? i read it's currently an anti-pattern but not sure why a. Technically, nothing prevents you from doing it. but definitely disable caching when doing it since the results may not be deterministic. Also, you could explore using sensors. cc @Alexander Walther -- Recording:
Hema Jayachandran09/12/2023, 7:13 PM
One way to cleanup might be to setI quite didn’t understood though why lifecycle has to be greater than max-cache age. Or it was just an example ?to 7d, and lifecycle objects in your bucket after 14 days.