melodic-eve-75962
08/07/2024, 11:22 AMpyflyte run --remote workflow.py workflowname --inputparam value
to start up a remote flyte workflow. I have in a folder my workflow.py which imports data.py which in turns imports a custom_types.py file.
All these 3 files lie in the same directory. However, only the data import works, the following custom_types import is failing, and I guess the python script is not even available on flyte.
--copy-all resolved this issue, but is there some documentation or output flag, or in the webview some data i can inspect to find out which files got uploaded/copied? I want to understand why data.py is avaible on flyte, but not the other one (custom_types.py is even also imported from workflow.py directly). I was developing and it was not added to git initially, so I also did that but did not help, is there perhaps also some caching of registered files going on? Seems very intransparent to me right now.
Any help is greatly appreciated 🙂high-accountant-32689
08/07/2024, 7:29 PMpyflyte run
quirk of loading a single file is mentioned in https://docs.flyte.org/en/latest/api/flytekit/design/clis.html#what-is-pyflyte-run.
As you noticed,
--copy-all
circumvents this by copying every file in the project. This combined with a .gitignore
is powerful and gives you control over which files are actually copied to the tarball that ends up being copied to the blob store.