Hi, I have tried to upgrade from v1.11.0 to v1.12....
# flyte-support
c
Hi, I have tried to upgrade from v1.11.0 to v1.12.3 or v1.13.5 but after the upgrade I am hitting a problem. I use jupyter notebook for development and then nbdev to create the library, and deploy from that. This has been working but after the upgrade, executing the cell with the task definition results in the following:
Copy code
in <module>:13                                                                                                  │
│                                                                                                                 │
│ ❱  13 @task(container_image=boto3_image_spec)                                                                   │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/task.py:328 in wrapper                                                                                │
│                                                                                                                 │
│ ❱ 328 │   │   task_instance = TaskPlugins.find_pythontask_plugin(type(task_config))(                            │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:85 in __call__                                                                             │
│                                                                                                                 │
│ ❱  85 │   │   o = super(InstanceTrackingMeta, cls).__call__(*args, **kwargs)                                    │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/python_function_task.py:134 in __init__                                                               │
│                                                                                                                 │
│ ❱ 134 │   │   name, _, _, _ = extract_task_module(task_function)                                                │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:336 in extract_task_module                                                                 │
│                                                                                                                 │
│ ❱ 336 │   │   mod_name = get_full_module_path(f, file_name)  # type: ignore                                     │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:348 in get_full_module_path                                                                │
│                                                                                                                 │
│ ❱ 348 │   │   new_mod_name = _mod_sanitizer.get_absolute_module_name(inspect.getabsfile(mod),                   │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:295 in get_absolute_module_name                                                            │
│                                                                                                                 │
│ ❱ 295 │   │   return self._resolve_abs_module_name(path, package_root)                                          │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:281 in _resolve_abs_module_name                                                            │
│                                                                                                                 │
│ ❱ 281 │   │   if "__init__.py" not in os.listdir(dirname):                                                      │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
FileNotFoundError: [Errno 2] No such file or directory: 
'/var/folders/sn/cfpmtf0555dgbd6lv9ljn1yh0000gp/T/ipykernel_51609'
g
mind giving v1.13.6b2 a try. we fixed some issues in the tracker.py https://github.com/flyteorg/flytekit/releases/tag/v1.13.6b2
c
Unfortunately the same error (slightly different traceback)
Copy code
╭─────────────────────────────────────── Traceback (most recent call last) ───────────────────────────────────────╮
│ in <module>:13                                                                                                  │
│                                                                                                                 │
│ ❱  13 @task(container_image=boto3_image_spec)                                                                   │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/task.py:352 in wrapper                                                                                │
│                                                                                                                 │
│ ❱ 352 │   │   task_instance = TaskPlugins.find_pythontask_plugin(type(task_config))(                            │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:81 in __call__                                                                             │
│                                                                                                                 │
│ ❱  81 │   │   o = super(InstanceTrackingMeta, cls).__call__(*args, **kwargs)                                    │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/python_function_task.py:133 in __init__                                                               │
│                                                                                                                 │
│ ❱ 133 │   │   name, _, _, _ = extract_task_module(task_function)                                                │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:332 in extract_task_module                                                                 │
│                                                                                                                 │
│ ❱ 332 │   │   mod_name = get_full_module_path(f, file_name)  # type: ignore                                     │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:344 in get_full_module_path                                                                │
│                                                                                                                 │
│ ❱ 344 │   │   new_mod_name = _mod_sanitizer.get_absolute_module_name(inspect.getabsfile(mod),                   │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:291 in get_absolute_module_name                                                            │
│                                                                                                                 │
│ ❱ 291 │   │   return self._resolve_abs_module_name(path, package_root)                                          │
│                                                                                                                 │
│ /Users/virtual_environments/.venv/lib/python3.11/site-packages/flyt │
│ ekit/core/tracker.py:277 in _resolve_abs_module_name                                                            │
│                                                                                                                 │
│ ❱ 277 │   │   if "__init__.py" not in os.listdir(dirname):                                                      │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
FileNotFoundError: [Errno 2] No such file or directory: 
'/var/folders/sn/cfpmtf0555dgbd6lv9ljn1yh0000gp/T/ipykernel_92213'
f
We are working on this and will resolve
c
Thanks, there is no rush, I just reverted back to a v1.11.0 version. (had hit a separate problem with the remote client and the type engine, but managed to fix that by passing
as_type
parameter).
Is there a Jira ticket I should follow?
f
Can you open a GitHub issue and put your details there
g
[flyte-bug]