#3550 [BUG] Overwrite cached outputs flag doesn't work for reference launchplans
Issue created by
yubofredwang
Describe the bug
When I trigger a workflow with overwrite cached outputs flag, the reference launchplans does not respect that flag. The tasks in the reference workflow still read cache from previous executions.
Expected behavior
When overwrite cached outputs flag is enabled, the reference launchplans that triggered as sub-workflows should also overwrite the cache.
If this is by design to have reference workflow to not respect the workflow, we should at least provide another flag/config to allow user to overwrite cache.
Additional context to reproduce
Create a workflow with reference workflow, enable caching on tasks and run with the overwrite cached outputs flag enabled.
Code Example:
File1
@task(
cache=True,
cache_version="1.0.0",
)
def fds_importer_parameter_serialization(a: str) -> str:
return "hello" + a
@workflow
def fds_importer(a: str):
fds_importer_parameter_serialization(a)
File2
@reference_launch_plan
def fds_importer(a: str):
...
@workflow
def my_workflow(a: str):
fds_importer(a)
Screenshots
Screenshot 2023-03-28 at 5 28 08 PM▾
Screenshot 2023-03-28 at 5 28 15 PM▾
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyte