sticky-art-97180
12/07/2022, 7:23 PMA
with inputs a,b,c
I have another wf B which find out what the inputs should be to wf A and “invokes” it. My current model is as below:
Are there better ways to handle this?
@workflow
A:
@workflow
B:
result = B(..)
thankful-minister-83577
thankful-minister-83577
thankful-minister-83577
sticky-art-97180
12/07/2022, 7:44 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
thankful-minister-83577
swift-animal-75798
12/08/2022, 1:50 PMWorkflow X:
- task A(): outputs a,b,c
- task B(a,b,c)
Workflow A()
- ...
- ...
outputs a,b,c
Workflow B(a,b,c)
...
Workflow X:
- workflow A(): outputs a,b,c
- workflow B(a,b,c)
sticky-art-97180
12/08/2022, 4:49 PMsticky-art-97180
12/13/2022, 1:09 AMsticky-art-97180
12/13/2022, 1:10 AMthankful-minister-83577
thankful-minister-83577
sticky-art-97180
12/13/2022, 2:06 AMground_truth_workflow = flytekit.LaunchPlan.get_or_create(
name="ground_truth_workflow",
workflow=GroundTruthOfflinePCPWorkFlow,
)
Dynamic tasks calls a launch plan.
@flytekit.dynamic
def run:
# Figures out number of iterations
# ground_truth_workflow(..)
thankful-minister-83577
thankful-minister-83577
thankful-minister-83577
thankful-minister-83577
sticky-art-97180
12/13/2022, 2:12 AMthe launch plan that you call will have its own parallelism settingOh nice, that’s great! 😅