Pryce07/19/2023, 5:00 PM
I think I should be using regular @tasks for any python driven tasks, ShellTask for anything that bash can control, and ContainerTask for everything else - in that order.+1
My logic being that ContainerTask has more overhead since the container isn't Flyte-aware.That shouldn't be the case because every task runs in a container. A raw ContainerTask is useful when you want to run non-Python tasks.
Pryce07/27/2023, 5:01 PM