Hi team I m suddenly running into a weird error with a map t

Question

Hi team I m suddenly running into a weird error with a map task 3rd time now Some of the map tasks fail with this error and eventually the whole workflow fails Nothing has changed as far as our config or workflow code is concerned The task has `interruptible=False` ```code UnexpectedObjectDeletion message object lt k8s namespace name gt a5vmlnn7xxvpbjv5qztd n6 0 33 terminated in the background manually```

Rupsha Chaudhuri · Answer

Also are successful map tasks not cached There were 20 that succeeded out of 50 but looks like on a recover relaunch they are running all over again

Ketan (kumare3) · Answer

Turn on inject finalizer you are running a lot of pods and they are being deleted by k8s

Rupsha Chaudhuri · Answer

Thanks let me try this It s curious since this workflow has been running for several months now

Rupsha Chaudhuri · Answer

Looks like we already have it set to true for copilot

Rupsha Chaudhuri · Answer

Do the propeller and scheduler also need it

Ketan (kumare3) · Answer

ohh you need it for propeller

Ketan (kumare3) · Answer

what is for co pilot

Ketan (kumare3) · Answer

that is not needed

Rupsha Chaudhuri · Answer

This is a screenshot of the yaml from flyte example setup So should the k8s plugin config with inject finalizer be under core gt propeller gt plugins gt k8s