Is it possible to cancel/terminate individual tasks in a workflow somehow?
y
Yee
02/21/2023, 4:37 PM
no… like a poison pill of sorts? when it kicks off, it automatically fails?
f
Felix Ruess
02/21/2023, 5:17 PM
No, more like the terminate for a workflow, but for an individual task in a workflow instead of all tasks in the workflow.
Or is this just missing in the console UI?
s
Samhita Alla
02/22/2023, 4:33 AM
@Felix Ruess, could you let us know your use case with regard to terminating a task in a workflow?
f
Felix Ruess
02/22/2023, 8:49 AM
My colleague asked if he could do that. He noticed that he made an error in one of his configs, which affected that task and he wanted to stop it, fix the config and relaunch the task.
But without stopping the other long running tasks in the workflow that were already started.
s
Samhita Alla
02/22/2023, 10:21 AM
I'm afraid that isn't possible. How about you checkpoint data during task execution?
f
Felix Ruess
02/22/2023, 10:29 AM
Checkpointing would currently be hard to do for our synthetic data generation which completely runs in Blender. None of those tasks are python tasks.
So this is currently not possible, but it was just not done or is there some reason why this would be difficult to add?
s
Samhita Alla
02/22/2023, 1:37 PM
@Yee?
@Eduardo Apolinario (eapolinario), what do you think of allowing users to terminate a task within a workflow?