varsha Parthasarathy
12/07/2022, 7:23 PMA
with inputs a,b,c
I have another wf B which find out what the inputs should be to wf A and “invokes” it. My current model is as below:
Are there better ways to handle this?
@workflow
A:
@workflow
B:
result = B(..)
Yee
varsha Parthasarathy
12/07/2022, 7:44 PMYee
Babis Kiosidis
12/08/2022, 1:50 PMWorkflow X:
- task A(): outputs a,b,c
- task B(a,b,c)
Workflow A()
- ...
- ...
outputs a,b,c
Workflow B(a,b,c)
...
Workflow X:
- workflow A(): outputs a,b,c
- workflow B(a,b,c)
varsha Parthasarathy
12/08/2022, 4:49 PMYee
varsha Parthasarathy
12/13/2022, 2:06 AMground_truth_workflow = flytekit.LaunchPlan.get_or_create(
name="ground_truth_workflow",
workflow=GroundTruthOfflinePCPWorkFlow,
)
Dynamic tasks calls a launch plan.
@flytekit.dynamic
def run:
# Figures out number of iterations
# ground_truth_workflow(..)
Yee
varsha Parthasarathy
12/13/2022, 2:12 AMthe launch plan that you call will have its own parallelism settingOh nice, that’s great! 😅