<#CP2HDHKE1|ask-the-community> We are dealing with...
# ask-the-community
s
#ask-the-community We are dealing with flyte in production generating enormous amounts of data in the S3 flytedata folder. Is there any housekeeping script or anything which the community is using to remove data from the flyte s3 and correspondingly delete entries from the postgres DB's
k
@Sujith Samuel you can use lifecycle policies in s3 to delete the data
just ensure that this matches your cache expiration time and you should be ok
flyteadmin may have some links that will become useless for old executions, but that is ok
g
how is the cache expiration time set?
s
@Ketan (kumare3) How can I set cache expiration time
s
@Ketan (kumare3), are you referring to
MaxCacheAge
in propeller config?
k
Aah yes
153 Views