We are having an issue with input parameters not being deterministic when moving up from flyte 1.13
We are runnin pyflyte with --params params.yaml
Seems to coincide with the msgpack update from 1.14. Do you no longer consider dicts to be deterministic input, even if resolved from the cli in flytekit/interaction/click_types.JsonParamType. Or is this a oversight
@task(cache=Cache(version="hard-coded",serialize=True))
def generic_task_no_params(dataset: str) -> str:
return dataset
@task(cache=Cache(version="hard-coded",serialize=True))
def generic_task(dataset: str, params: dict) -> str:
return dataset
@workflow
def generic_wf(dataset: str, params: dict) -> None:
generic_task_no_params(dataset=dataset) # caching works
generic_task(dataset=dataset, params=params) # no caching
generic_task(dataset=dataset, params=params["key"]) # no caching
Note that this worked perfect with cache hits when we were at 1.13 version