I'm would like to specify cache version in a file, similarly to how docker images are specified in config.yaml in the last example on this page: https://docs.flyte.org/en/latest/flytesnacks/examples/customizing_dependencies/multi_images.html. Is this possible? I tried setting the cache version to the docker version like this:

my_config = {

"cache": True,

"container_image": "{{.<http://image.my|image.my>_image.fqn}}:{{.<http://image.my|image.my>_image.version}}",

"cache_version": "{{.<http://image.my|image.my>_image.version}}",

}

@task(**my_config)

def my_task(...):

...

but it doesn't work because only the container_image field is evaluated. The cache_version if field is simply parsed as string. Is there a way to propagate the cache version from the config.yaml file?

i’d avoid a config file if you can

I want to have the option to invalidate and thereby regenerate the cache without manually changing the cache_version string in the code (for nightly runs, integration tests, et.c.). Preferably, it shouldn't be tied to the docker version but it would be nice to be able to specify it in a similar manner.

that doesn’t exist at the pyflyte layer.

I think the workaround you suggest will work and I fully agree that the cache version shouldn't be tied to the docker version. But I still think it's desirable to enable convenient injection of the cache version into a run. Caches will be invalidated every now and then, and to be able to trigger automatic cache regeneration is critical when sharing cache in larger team, imo.

you can already re-run a cache with the same version.