Rupsha Chaudhuri
09/23/2022, 4:41 PMobject [my_domainctw5x2vdnkvd-n0-0] terminated in the background, manually
interruptible=False
to see if it alleviates the problem since it’s running on spot instancesDan Rammer (hamersaw)
09/23/2022, 4:48 PMKetan (kumare3)
finalizer
Rupsha Chaudhuri
09/23/2022, 5:40 PMinterruptible=False
it got evicted… will look into thisDan Rammer (hamersaw)
09/26/2022, 9:59 PMRupsha Chaudhuri
09/26/2022, 9:59 PMDan Rammer (hamersaw)
09/26/2022, 10:00 PMRupsha Chaudhuri
09/27/2022, 6:22 AMDan Rammer (hamersaw)
09/27/2022, 12:09 PMit's a task that triggers a job running somewhere else and monitors it
sounds like Flyte is just missing a plugin here? so you're using spot instances because they are not actually doing any work, just starting and monitoring an external job?Rupsha Chaudhuri
09/27/2022, 3:52 PMExpected exactly one checkpoint - found 0
Dan Rammer (hamersaw)
09/27/2022, 11:08 PMRupsha Chaudhuri
09/28/2022, 1:55 AMKetan (kumare3)
Rupsha Chaudhuri
09/28/2022, 2:53 AM