Hi team.. Can `dynamic` be cached?

little-cricket-84530

06/14/2022, 5:27 PM

Hi team.. Can

dynamic

be cached?

broad-monitor-993

06/14/2022, 5:32 PM

indeed! https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.dynamic.html#flytekit-dynamic

little-cricket-84530

06/14/2022, 5:39 PM

Interesting.. I was confused because in the console I don't see the little check mark next to it to indicate that the output was written to cache

broad-monitor-993

06/14/2022, 7:46 PM

ooo, would you mind taking a screenshot and posting here?

little-cricket-84530

06/14/2022, 7:51 PM

n1 and n2 are dynamic with caching enabled

little-cricket-84530

06/14/2022, 7:51 PM

Do I need to also enable caching in the called tasks for the cache at the dynamic task to work?

broad-monitor-993

06/14/2022, 9:11 PM

hmm, so the dynamic workflow cache should be independent of the caching of tasks invoked within it. @late-eye-50215 dynamic workflows should have a circle-y checkmark thing if it’s cached, no?

powerful-byte-25482

06/28/2022, 4:48 PM

sry missed this message. checking the cache dynamic workflows...

powerful-byte-25482

06/28/2022, 9:52 PM

@little-cricket-84530 really sorry for the late reply. yes. the dynamic task can be cached, and it should show on the UI. However, there is a bug in the Flyte console which first time when execute the dynamic task it won’t show any cache icon (it should show

cache_populated

), but the second time when execute the dynamic task with the same input, it should said

cache_hit

Please let me know if you have further questions or face any issues 🙂

little-cricket-84530

06/28/2022, 10:16 PM

thank you

🙂 1

245 Views

Open in Slack

Previous Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.