https://flyte.org logo
Title
v

Victor Gustavo da Silva Oliveira

01/30/2023, 6:22 PM
Hello! I want to know what is the best way to deal with image files in and between tasks, and if the Flytectl image files do this job in a optimized way. In addiction, when I create an task to download the images and do some operation, when the task is done, it will clean the local storage or do I need to do it manually?
j

Jay Ganbat

01/30/2023, 8:09 PM
your tasks are running in the cluster right? backend should provision ephemeral storage and clean it up once its done I think. Also
pod-task
plug should give you the option to specify custom image to run the task on, i havent used that in a while but last time it has these options 😅
k

Ketan (kumare3)

01/30/2023, 11:49 PM
not only pod task you can simply pass
container_image
as an option to specify the image. But I assume you are talking about “images” as in “png” etc. Yes in that case, Flytekit will download the images and will be automatically deleted on container exit
j

Jay Ganbat

01/30/2023, 11:56 PM
hahaha duhh 🤦 word image completely changed meaning in my head 🤣
k

Ketan (kumare3)

01/31/2023, 12:48 AM
haha
v

Victor Gustavo da Silva Oliveira

01/31/2023, 5:18 PM
Cool, but in this situation, the downloaded images only will be deleted after the workflow execution, right? Is there a way to clean the storage after each task?
j

Jay Ganbat

01/31/2023, 5:55 PM
it should be cleaned up once task is done if you are downloading image in the task, well you cant download stuff in worklows anyway 😅 so yeah ephemeral storage will get cleaned up once task is complete (pod is gone)
v

Victor Gustavo da Silva Oliveira

01/31/2023, 7:20 PM
Thanks a lot for your help guys!