https://flyte.org logo
#ask-the-community
Title
# ask-the-community
h

Han

04/22/2022, 10:17 PM
Quick question. we have people working on a shared server. I have written a workflow that runs locally under my env. But when my colleague tries to run the same workflow on the server, he got the following error
Copy code
$ python tasks/run_workflow.py
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/pathlib.py", line 1284, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/flyte/20220422_220444/sandbox/local_flytekit'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/pathlib.py", line 1284, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/flyte/20220422_220444/sandbox'

During handling of the above exception, another exception occurred:
...
...
PermissionError: [Errno 13] Permission denied: '/tmp/flyte/20220422_220444'
How do I ensure reproducibility for different local environments?
e

Eduardo Apolinario (eapolinario)

04/22/2022, 10:23 PM
@Han, can you share more details about your workflow? How are you running it? And how is your colleague running it?
h

Han

04/22/2022, 10:25 PM
We both work on the same shared server. We are both just doing
python run_workflow.py
from our user accounts on that server.
k

Ketan (kumare3)

04/22/2022, 11:14 PM
aah you mean shared-server for the local development?
it is like a jupyter shared server?
it seems you do not have permissions to create
/tmp/flyte
folder?
e

Eduardo Apolinario (eapolinario)

04/22/2022, 11:16 PM
Can you double check if your colleague has access to /tmp/flyte?
k

Ketan (kumare3)

04/22/2022, 11:16 PM
@Eduardo Apolinario (eapolinario) i think what happened is one of them first created
/tmp/flyte
and the second person cannot access it, as we restrict it to the uid only
we should probably create a random sandbox per vm?
h

Han

04/23/2022, 2:30 AM
Yes! It's a shared server for development (bare metal). I am guessing that I ran a workflow “locally”, and flyte setup local temp, but others don't have permissions. So when they try to run flyte workflow on their accounts they don't have access and get blocked.
I can try to ask admin to open up access of that folder for everyone, not sure how would flyte sandbox change the permissions after a workflow run tho.
k

Ketan (kumare3)

04/23/2022, 2:33 AM
No we will change this, if you can get by for a bit
h

Han

04/23/2022, 3:31 AM
Ok. Please keep me posted.
k

Ketan (kumare3)

04/23/2022, 3:47 AM
@Eduardo Apolinario (eapolinario) made a PR
@Han this was merged, slated for the next beta
will keep you posted
🔥 1
e

Eduardo Apolinario (eapolinario)

04/26/2022, 8:24 PM
@Han, can you give flytekit 1.0.0 a try?
h

Han

04/26/2022, 8:27 PM
Yes, lemme grab it
guess it will take a while to propagate to our internal repo
7 Views