green-agency-30976
10/25/2023, 10:22 AM#running-flyte-workflows-in-python
step fails because it’s trying to create folder with a colon :
in the path.
$ pyflyte run flyte_getting_started.py training_workflow \
--hyperparameters '{"C": 0.1}'
Running Execution on local.
2023-10-25 11:17:23,703140 ERROR {"asctime": "2023-10-25 11:17:23,703", "name": "flytekit", "levelname": "ERROR", "message": "Failed to base_task.py:552
convert outputs of task 'flyte_getting_started.get_data' at position 0:\n [Errno 2] Failed to open
local file
'/var/folders/1m/qqnf7ljn5kl9jds73t5mnrz00000gn/T/flyte-d0jyb_mw/raw/1852564a04fd8504c48f9ba713ee2dea/0
0000'. Detail: [errno 2] No such file or directory"}
Failed with Unknown Exception <class 'TypeError'> Reason: Encountered error while executing workflow 'flyte_getting_started.training_workflow':
Error encountered while executing 'training_workflow':
Failed to convert outputs of task 'flyte_getting_started.get_data' at position 0:
[Errno 2] Failed to open local file '/var/folders/1m/qqnf7ljn5kl9jds73t5mnrz00000gn/T/flyte-d0jyb_mw/raw/1852564a04fd8504c48f9ba713ee2dea/00000'. Detail: [errno 2] No such file or directory
Encountered error while executing workflow 'flyte_getting_started.training_workflow':
Error encountered while executing 'training_workflow':
Failed to convert outputs of task 'flyte_getting_started.get_data' at position 0:
[Errno 2] Failed to open local file '/var/folders/1m/qqnf7ljn5kl9jds73t5mnrz00000gn/T/flyte-d0jyb_mw/raw/1852564a04fd8504c48f9ba713ee2dea/00000'. Detail: [errno 2] No such file or directory
You can see below that the file:
folder looks odd
$ tree
.
├── __pycache__
│ └── flyte_getting_started.cpython-310.pyc
├── file:
│ └── var
│ └── folders
│ └── 1m
│ └── qqnf7ljn5kl9jds73t5mnrz00000gn
│ └── T
│ └── flyte-d0jyb_mw
│ └── raw
│ └── 1852564a04fd8504c48f9ba713ee2dea
└── flyte_getting_started.py
Note that the environment setup worked. Running on macOS Ventura, Python 3.10.12, flytekit = “^1.10.0", flytekitplugins-deck-standard = “^1.10.0”broad-train-34581
10/25/2023, 10:28 AMgreen-agency-30976
10/25/2023, 10:35 AM"fsspec>=2023.3.0,<=2023.9.2"
fixes it for now without having to get a beta version