Hello! I want to know what is the best way to deal with image files in and between tasks, and if the Flytectl image files do this job in a optimized way. In addiction, when I create an task to download the images and do some operation, when the task is done, it will clean the local storage or do I need to do it manually?

your tasks are running in the cluster right? backend should provision ephemeral storage and clean it up once its done I think. Also

pod-task

plug should give you the option to specify custom image to run the task on, i havent used that in a while but last time it has these options 😅

not only pod task you can simply pass

container_image

as an option to specify the image. But I assume you are talking about “images” as in “png” etc. Yes in that case, Flytekit will download the images and will be automatically deleted on container exit

hahaha duhh 🤦 word image completely changed meaning in my head 🤣

haha

Cool, but in this situation, the downloaded images only will be deleted after the workflow execution, right? Is there a way to clean the storage after each task?

it should be cleaned up once task is done if you are downloading image in the task, well you cant download stuff in worklows anyway 😅 so yeah ephemeral storage will get cleaned up once task is complete (pod is gone)

Thanks a lot for your help guys!