Nicholas LoFaso01/31/2022, 6:00 PM
Dan Rammer (hamersaw)02/01/2022, 1:21 PM
Nicholas LoFaso02/01/2022, 1:23 PM
, but I noticed the same behavior with
tasks as well. If that helps troubleshooting.
Dan Rammer (hamersaw)02/03/2022, 3:59 PM
that is set on the plugins configmap for flytepropeller. It controls, as you may guess, whether or not k8s resources are deleted when flyte attempts to finalize the task. In your above configuration this may look like:
In my testing I was able to not delete dynamic task pods on completion / failure. Let me know if this works for you and / or if you run into any more issues.
configmap: k8s: plugins: k8s: default-env-vars: - FLYTE_STATSD_HOST: "flytestatsd.datadog.svc.cluster.local" - FLYTE_STATSD_DISABLE_TAGS: "True" delete-resource-on-finalize: false create-container-error-grace-period: 8m0s
Nicholas LoFaso02/04/2022, 2:43 PM
and hopefully that will resolve the issue