Franco Bocci
08/15/2023, 8:45 AMFailed to cache Dynamic workflow [[CACHE_WRITE_FAILED] Failed to Cache the metadata, caused by: The entry size is larger than 1/1024 of cache sizeIn the propeller optimization guide I saw that there is supposed to be a
storage.cache
field to tune this, but I could not find examples about how to fill that (is it a number? a string? a map?).
Would you link me to some resource about this?Dan Rammer (hamersaw)
08/15/2023, 8:12 PM1/1024
is a constraint from the freecache (v1.1.1) library we're using. However, as you mentioned we can configure the cache size using the max_size_mbs
option (example here). If this value is set to 0
then the cache is disabled.
Looking through these values in the flyte deployments it seems like they should be updated as they're relatively arbitrary. Are you using a default deployment and running into these issues?Franco Bocci
08/16/2023, 10:17 AM