Nicholas Roberson
07/19/2023, 3:56 PM.with_overrides(
container_image=base_container_image_url_str
)
is not working. I have access to the base container url string. Any ideas here? I cant seem to get the image to update and have looked into ImageSpec
but cant seem to get that working at the moment.
Is there a way to set this in the @task(task_config=...)
?Fabio Grätz
07/19/2023, 4:18 PM@task
itself has a container_image
arg, can you use this one? You can pass a string.Fabio Grätz
07/19/2023, 4:20 PMFabio Grätz
07/19/2023, 4:20 PMNicholas Roberson
07/19/2023, 4:25 PM@task(
container_image="<container image url"
)
but have not been successful. Would running this in map_task
affect this at all?Nicholas Roberson
07/19/2023, 4:26 PMFabio Grätz
07/19/2023, 4:26 PMNicholas Roberson
07/19/2023, 4:27 PMFabio Grätz
07/19/2023, 4:27 PMImage reference is specified, but the version is derived from the default images version container_image="<http://docker.io/redis:{{.image.default.version}}|docker.io/redis:{{.image.default.version}}>,
Both the FQN and the version are derived from the default image container_image="{{.image.default.fqn}}:spark-{{.image.default.version}},
The images themselves are parameterizable in the config in the following format:
{{.image.<name>.<attribute>}}
Fabio Grätz
07/19/2023, 4:28 PM{{..
is actually required.Fabio Grätz
07/19/2023, 4:28 PMNicholas Roberson
07/19/2023, 4:29 PMXinzhou Liu
07/19/2023, 4:39 PM{{.image.<name>.<attribute>}}
doesn’t support digest <image_name>@sha256:<hash>
?Nicholas Roberson
07/19/2023, 6:39 PMKetan (kumare3)
Xinzhou Liu
07/19/2023, 8:22 PMXinzhou Liu
07/19/2023, 8:26 PM@task(container_image=<image_name>@sha256:<hash>)
works however. I think it could be useful to support digest in `map_task`’s with_overrides
as well since digest is more specific. Can it be added to the roadmap?Samhita Alla
Eduardo Apolinario (eapolinario)
07/20/2023, 5:36 PM