miniature-plumber-7394
02/21/2023, 8:59 PMpyflyte register
not use the docker image when its packaging the workflow. We have some custom dependencies for the workflow to execute that aren’t present in the development environment.quaint-diamond-37493
02/21/2023, 9:05 PMquaint-diamond-37493
02/21/2023, 9:07 PMminiature-plumber-7394
02/21/2023, 9:07 PMminiature-plumber-7394
02/21/2023, 9:08 PMquaint-diamond-37493
02/21/2023, 9:08 PMminiature-plumber-7394
02/21/2023, 9:11 PMquaint-diamond-37493
02/21/2023, 9:11 PMminiature-plumber-7394
02/21/2023, 9:12 PMminiature-plumber-7394
02/21/2023, 9:12 PMminiature-plumber-7394
02/21/2023, 9:13 PMquaint-diamond-37493
02/21/2023, 9:14 PMminiature-plumber-7394
02/21/2023, 9:16 PMquaint-diamond-37493
02/21/2023, 9:18 PMminiature-plumber-7394
02/21/2023, 9:29 PMthankful-minister-83577
--image
flag.thankful-minister-83577
miniature-plumber-7394
02/21/2023, 9:31 PMminiature-plumber-7394
02/21/2023, 9:40 PMpyflyte register workflows --image localhost:30000/retsynth:cc6bf85d7bbadba83419f40003cc9a16f962fda7
However I it looks like its using the local python installation from the log. Also this package isn’t present in my dev machine but it is present in the image. Here’s the rest of the error dump
Running pyflyte register from /root/sandbox/retsynth-history-fix/retsynth_new with images ImageConfig(default_image=Image(name='default', fqn='localhost:30000/retsynth', tag='cc6bf85d7bbadba83419f40003cc9a16f962fda7'), images=[Image(name='default', fqn='localhost:30000/retsynth', tag='cc6bf85d7bbadba83419f40003cc9a16f962fda7')]) and image destination folder /root on 1 package(s) ('/root/sandbox/retsynth-history-fix/retsynth_new/workflows',)
Registering against localhost:30080
Detected Root /root/sandbox/retsynth-history-fix/retsynth_new, using this to create deployable package...
No output path provided, using a temporary directory at /tmp/tmpyq__xk3m instead
Computed version is k_CYhVf7JigGDT-ocAa7qg==
Loading packages ['workflows'] under source root /root/sandbox/retsynth-history-fix/retsynth_new
Traceback (most recent call last):
File "/root/.pyenv/versions/3.8.0/bin/pyflyte", line 8, in <module>
sys.exit(main())
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/click/decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/clis/sdk_in_container/register.py", line 184, in register
raise e
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/clis/sdk_in_container/register.py", line 168, in register
repo.register(
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/tools/repo.py", line 255, in register
serializable_entities = load_packages_and_modules(
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/tools/repo.py", line 179, in load_packages_and_modules
registrable_entities = serialize(pkgs_and_modules, ss, str(project_root), options)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/tools/repo.py", line 46, in serialize
module_loader.just_load_modules(pkgs=pkgs)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/site-packages/flytekit/tools/module_loader.py", line 33, in just_load_modules
importlib.import_module(name)
File "/root/.pyenv/versions/3.8.0/lib/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
from tqdm import tqdm
ModuleNotFoundError: No module named 'tqdm'
miniature-plumber-7394
02/21/2023, 9:40 PMminiature-plumber-7394
02/21/2023, 9:41 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
miniature-plumber-7394
02/21/2023, 9:44 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
miniature-plumber-7394
02/21/2023, 9:45 PMminiature-plumber-7394
02/21/2023, 9:46 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
miniature-plumber-7394
02/21/2023, 9:47 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
miniature-plumber-7394
02/21/2023, 9:48 PMthankful-minister-83577
miniature-plumber-7394
02/22/2023, 1:07 AMcool-lifeguard-49380
02/22/2023, 8:14 AMHow can I monitor the std out and std err while the task is running ?Do
kubectl get pods --namespace flytesnacks-development
(or whichever namespace your task is running in. If you don’t know, you can do kubectl get pods --all-namespaces
. Find out the name of your pod running the task.
Then, kubectl --namespace flytesnacks-development logs -f <pod name>
(remove the <
). This streams the logs of your task.