Terence Kent
09/22/2023, 8:00 PMpyflyte run
to mess around with some basic Flyte workflows, just getting familiar with it.map_task
feature, running the workflow against a dev cluster. Unfortunately, I'm doing something wrong. In every attempt, using either pyflyte build
, pyflyte run
, etc, I get the following as soon as I include a map_task
call in my @workflow
function.Failed with Unknown Exception <class 'ModuleNotFoundError'> Reason: Error encountered while executing 'maptask_sample':
Module from file ../flyte-local-playground/simple-py-workflow/venv/bin/pyflyte cannot be loaded
Error encountered while executing 'maptask_sample':
Module from file ../flyte-local-playground/simple-py-workflow/venv/bin/pyflyte cannot be loaded
main
) works just fine and if I remove any map_task
calls it works in the dev cluster. I'm clearly missing something here, can somebody point me in the right direction?map_task
.
I had placed my python venv
folder inside of the flyte project folder and also had pyflyte
installed there. Apparently, in that condition, the error above happens.
Just setting up pyflyte
in a different parent directory's venv
fixed the problem. That took a minute.Joe Hartshorn
09/28/2023, 10:45 AMplaced my pythonThis is standard for all our python projects, why does it cause issues here?folder inside of the flyte project foldervenv
Terence Kent
09/28/2023, 4:20 PMmap_task
usage. Were you actually running into the same situation related to `pytflyte`'s venv
and the other issue, or just the other issue?Joe Hartshorn
10/03/2023, 8:01 AM