Bernhard Stadlbauer
02/07/2023, 1:17 PMWorkflow[<worfklow-id>] failed. RuntimeExecutionError: max number of system retry attempts [51/50] exhausted. Last known status message: Failed to check Catalog for previous results: DataCatalog failed to get dataset for ID resource_type:TASK name:"<task-id>" version:"<task-version>" : rpc error: code = InvalidArgument desc = missing project
This seems to come from here, but I’m not quite sure why project
would be empty hereDan Rammer (hamersaw)
02/07/2023, 11:16 PMBernhard Stadlbauer
02/08/2023, 6:24 AMDan Rammer (hamersaw)
02/08/2023, 10:18 AMBernhard Stadlbauer
02/08/2023, 10:20 AMfrom flytekit import workflow, task, dynamic
@task
def some_task():
print("Do something")
@dynamic
def dynamic_task():
some_task()
@workflow
def my_workflow():
dynamic_task()
Then triggering my_workflow()
from the UI already failsDan Rammer (hamersaw)
02/08/2023, 1:55 PMBernhard Stadlbauer
02/08/2023, 2:21 PMpip install git+<https://github.com/bstadlbauer/flytekit.git@fix-dynamic-serialization>
In case you wanna be save against modificatoin, you can also point directly to the commit:
pip install git+<https://github.com/bstadlbauer/flytekit.git@5e0a270>
I’ve also created a corresponding issueDan Rammer (hamersaw)
02/09/2023, 1:01 PMBernhard Stadlbauer
02/13/2023, 10:53 AM