gray-france-29038
11/17/2023, 5:07 PM@task(cache=True, cache_version="1.0", requests=Resources(mem="12Gi", cpu="1"), retries=1)
def write_data(cfg: DictConfig, key: str) -> None:
....
and I am parallelizing over keys in my workflow as follows:
partial_task = partial(write_data, cfg=cfg)
map_task(partial_task, concurrency=30, min_success_ratio=0.8)(key=keys)
I am using flytekit version 1.10.0
magnificent-teacher-86590
11/17/2023, 6:25 PMmagnificent-teacher-86590
11/17/2023, 6:25 PMmetadata=TaskMetadata(
cache=True,
cache_version=VERSION)
gray-france-29038
11/21/2023, 11:46 AMcaching was disabled for this execution
in the flyte console:glamorous-carpet-83516
11/22/2023, 12:07 AMuser
11/22/2023, 12:07 AMglamorous-carpet-83516
11/22/2023, 12:07 AMmagnificent-teacher-86590
11/22/2023, 12:26 AMhallowed-mouse-14616
11/27/2023, 10:50 AM