https://flyte.org logo
#ask-the-community
Title
# ask-the-community
t

Taeef Najib

07/23/2022, 4:55 PM
I was trying to test Pima Diabetes project using Flyte as per the documentation. When I try:
Copy code
pyflyte run --remote model.py:diabetes_xgboost_model
The first task (split_traintest_dataset) fails and I get this error:
Copy code
[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[ffeb1a0e5b4f44d81a8c-n0-0] terminated with exit code (1). Reason [Error]. Message: 
cked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/root/model.py", line 14, in <module>
    import joblib
ModuleNotFoundError: No module named 'joblib'
Traceback (most recent call last):
  File "/usr/local/bin/pyflyte-fast-execute", line 8, in <module>
    sys.exit(fast_execute_task_cmd())
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/flytekit/bin/entrypoint.py", line 506, in fast_execute_task_cmd
    subprocess.run(cmd, check=True)
  File "/usr/local/lib/python3.10/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-ffeb1a0e5b4f44d81a8c/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-ffeb1a0e5b4f44d81a8c/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/kh/ffeb1a0e5b4f44d81a8c-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/kh/ffeb1a0e5b4f44d81a8c-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/bc/flytesnacks/development/NBHGKLLB7JMWQJQQLZNV66UGGU======/scriptmode.tar.gz>', '--dynamic-dest-dir', '.', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'model', 'task-name', 'split_traintest_dataset']' returned non-zero exit status 1.
.
`Any idea what's wrong? I faced a similar issue while trying the MNIST digits classification project.
k

Ketan (kumare3)

07/23/2022, 5:43 PM
Your docker image does not have joblib Installed
t

Taeef Najib

07/23/2022, 5:54 PM
I have joblib installed in my computer. Any idea why it is not installed on my docker image? I tried this:
Copy code
docker run --network dask -e EXTRA_CONDA_PACKAGES="joblib" <http://ghcr.io/dask/dask|ghcr.io/dask/dask> dask-worker scheduler:8786
but no luck! Sorry I'm a noob.
k

Ketan (kumare3)

07/23/2022, 7:29 PM
Please try to follow the docs https://docs.flyte.org/en/latest/getting_started/index.html - how to Handle custom dependencies
👍 1
s

Samhita Alla

07/24/2022, 7:16 AM
@Taeef Najib, can you send
--image <http://ghcr.io/flyteorg/flytecookbook:pima_diabetes-latest|ghcr.io/flyteorg/flytecookbook:pima_diabetes-latest>
to pyflyte run command?
Copy code
pyflyte run --image <http://ghcr.io/flyteorg/flytecookbook:pima_diabetes-latest|ghcr.io/flyteorg/flytecookbook:pima_diabetes-latest> --remote model.py diabetes_xgboost_model
(you don’t need
:
between python file and workflow for the latest flytekit version) You can find all the relevant images for case studies and tutorials here.
t

Taeef Najib

07/24/2022, 7:53 PM
@Samhita Alla thank you!
74 Views