I have been unable to

remote run

my workflow. I am running:

pyflyte run --remote workflows/training.py pytorch_training_wf

But the workflow fails with:

│ │ /opt/conda/envs/envd/lib/python3.10/importlib/__init__.py:126 in             │                                                                                                                                     │
│ │ import_module                                                                │                                                                                                                                     │
│ │                                                                              │                                                                                                                                     │
│ │ ❱ 126 │   return _bootstrap._gcd_import(name[level:], package, level)        │                                                                                                                                     │
│ │ in _gcd_import:1050                                                          │                                                                                                                                     │
│ │ in _find_and_load:1027                                                       │                                                                                                                                     │
│ │ in _find_and_load_unlocked:1004                                              │                                                                                                                                     │
│ ╰──────────────────────────────────────────────────────────────────────────────╯                                                                                                                                     │
│ ModuleNotFoundError: No module named 'training'

Try another file name

i haven't not gotten any examples from the docs working with 1.10.3, that above error has happened to me a few times

I amen change the file name From training.py to another

trying it

How about go into the directory?

same issue

Will take a look 4 hours later

also for some reason, --image doesn't use the image that i passed in

--image

doesn't work because you had already specified image in

container_image

i think i know why

why

https://docs.flyte.org/en/latest/api/flytekit/pyflyte.html#pyflyte-run

Note: This command is compatible with regular Python packages, but not with namespace packages. When determining the root of your project, it identifies the first folder without an __init__.py file.

oh nice

it worked for a different image spec workflow. I am trying it for my pytorch flow

ok nice

issue is not solved the only difference between my buildspecs is

custom_image = ImageSpec(
    name="kfpytorch-flyte",
    packages=["torch", "torchvision", "flytekitplugins-kfpytorch", "matplotlib", "tensorboardX"],
    registry="xxxxxxxx/flyte",
    cuda="11.2.2",
    cudnn="8", 
    python_version="3.10"
)

and the other does not contain cuda or cudn

thank you for telling me that

I was able to replicate it with this workflow: if i run other workflows that dont' have cuda or cudnn, those don't have the module error

from flytekit import ImageSpec, task, workflow

custom_image = ImageSpec(
    name="kfpytorch-flyte",
    packages=["flytekit", "torch", "torchvision", "flytekitplugins-kfpytorch", "matplotlib", "tensorboardX"],
    registry="xxxxx",
    cuda="11.2.2",
    cudnn="8", 
    python_version="3.10"
)

@task(container_image=custom_image)
def bar() -> str:
    return 'foo'

@workflow
def foo_wf(
): 
    bar()


if __name__ == "__main__":
    foo_wf()

This should produce:

ModuleNotFoundError: No module named 'workflows'

If that is run from `pyflyte run --remote workflows/example.py foo_fw

which version of envd you are using?

envd==0.3.45

@hallowed-dog-74273 did you figure it out?

no i haven't looked at this in a while