red-addition-62324
01/13/2024, 11:20 AMtask1
which is a cached task that returns a dataframe annotated with Annotated[pd.DataFrame,(hash_pandas_dataframe)]
as suggested in the user guide
When running a map task on this I'm always getting a cache miss.
After some investigation I realised this is due to the way that the array task name is generated, it includes the python_interface
of the task which has the following form:
(-> (o0: typing.Annotated[pandas.core.frame.DataFrame, <flytekit.core.hash.HashMethod object at 0x7fd3e5b818d0>])
This is due to the HashMethod initializtion in the task definition.
Is there a workaround?red-addition-62324
01/13/2024, 12:19 PMred-addition-62324
01/16/2024, 10:38 AMhallowed-mouse-14616
01/16/2024, 1:21 PMhallowed-mouse-14616
01/16/2024, 3:37 PMred-addition-62324
01/16/2024, 3:37 PMflat-area-42876
01/22/2024, 8:06 PMred-addition-62324
01/23/2024, 5:32 PM