Hi all, I'm trying to understand flyte orchestration.
Our flyte app has a meta workflow containing sub-workflows (preparation, processing, training).
in one of the spark workflow, we have a task whose output is not being used by other tasks or sub-workflows and I'm trying to understand why the next sub-workflow is not starting its run while this task is running? is the orchestration only between tasks?
t
tall-lock-23197
12/05/2023, 9:26 AM
it has to! would you mind sharing your code? is that sub-workflow depending on any previous task or workflow input?