Hi all! we are interesting in implementing Flyte a...
# ask-the-community
Hi all! we are interesting in implementing Flyte as part of our MLOps effort at our company but running into some issues with the demo example: https://docs.flyte.org/projects/cookbook/en/latest/index.html
Copy code
"Failed to convert outputs of task                         base_task.py:552
'flyte_example.get_data' at position 0:\n  [Errno 2] Failed to open local file '/tmp/flyte-ndl0qvst/raw/1c5c90a099435310be8d080378201c38/00000'.                       
Detail: [errno 2] No such file or directory"
Any help would be appreciated to point us in the right direction. Thanks!
i ran into the same issue, but was able to run the demo on a local cluster following the steps in https://docs.flyte.org/projects/cookbook/en/latest/index.html#running-workflows-in-a-flyte-cluster
(i just started at union.ai as a tech writer for flyte this week, so am going through the docs and noting where example code isn't working)
@Tristan Bonds so you mean running this
pyflyte run example.py training_workflow --hyperparameters '{"C": 0.1}
led you to that error? I'm wondering what
thanks for the quick responses! yes @David Espejo (he/him) that command exactly
@Nikki Everett we also have set it up in our Kubernetes cluster but running into some issues when we are trying to run the command with the --remote arg as well
here is the code I put into the example file. There isn't a
in here
@Nikki Everett local cluster is not same as local execution. Local execution is where it runs in the python virtual environment. It’s most likely that you do not have write permissions or the file was deleted. Cc @Eduardo Apolinario (eapolinario) we should probably add a check to local reader that provides better errors?
I have been thinking if we can test the raw path for read write on startup
In pyflyte run
I encountered this error yesterday, and it likely relates to fsspec. I suggest downgrading your fsspec to < 2023.10.0. https://github.com/flyteorg/flyte/issues/4326
Can confirm that by installing fsspec to 2023.9.2 the example from the docs (for local run) that I just copy and paste from the docs now works just fine:
Copy code
pip install fsspec==2023.9.2 s3fs==2023.9.2 gcsfs==2023.9.2
@Samhita Alla / @Eduardo Apolinario (eapolinario) should we merge the PR?