Tim Bauer
07/14/2022, 2:39 PMtar_strip_file_attributes
functions. What is the purpose of that? When unpacking fast-registered archives it messes up the permissions:
d--------- 3 root root 4096 Jul 14 14:04 unpacked
-rw-r--r-- 1 root root 335 Jul 14 13:59 scriptmode.tar.gz
It doesn't matter if you run as root but we deliberately don't in our containers so everything fast-registered with new flytekit currently breaks.Ketan (kumare3)
Tim Bauer
07/14/2022, 2:41 PMKetan (kumare3)
Tim Bauer
07/14/2022, 2:42 PMdrwxr-xr-x
Ketan (kumare3)
Tim Bauer
07/14/2022, 2:52 PMdrwx------ 7 tim tim 4096 Jan 1 1970 fixed
-rw-rw-r-- 1 tim tim 583680 Jul 14 16:48 fixed.tar.gz
uid and gid seem to overwritten when unpackingpyflyte run --remote
still doesn't work. I noticed that it sets the -dest-dir
argument to /root
And also it seems to strip the workflow path defined in `flyte.config`:
[sdk]
# This option specifies the python packages where-in to search for workflows and tasks workflow packages.
workflow_packages=src.workflows
from the workflow files.
I'm running a workflow called "my_wf" from src/workflows/examples/hello_world.py
- with pyflyte run --remote this gets registered as "examples.hello_world.my_wf", the final argument to pyflyte-execute thus also becomes
-- task-module examples.hello_world
but I want it to be
-- task-module src.workflows.examples.hello_world
Ketan (kumare3)
Tim Bauer
07/14/2022, 3:08 PM[auth]
kubernetes_service_account=vault
It runs pods with defaultKetan (kumare3)
Tim Bauer
07/14/2022, 3:19 PMrun_level_params
object is being put together in the click context?Ketan (kumare3)
Greg Gydush
08/16/2022, 4:57 PMOne more thing I now noticed that pyflyte run doesnt pick up on the service account@Ketan (kumare3) having a similar issue where the service account specified during registration matches the service account used when a workflow is ran from the UI but does not match the service account used when executing from FlyteRemote