Channels
#ask-the-community
Title
# ask-the-community
v
Vasu Upadhya
03/06/2023, 6:57 PM👋 Hi! pyflyte fast registration command takes at least 5+ minutes every time when packaging and registering via github action on to a standalone cluster? Thoughts?
f
Fabio Grätz
03/06/2023, 7:01 PMCan you please check your root folder size with
du -chd 1(Ah, didn’t see this is in CICD, this makes it less likely the folder is large.)
The contents of the root folder are copied into a tarball and uploaded to blob storage. I have seen in the past that e.g. the
.gitv
Vasu Upadhya
03/06/2023, 7:18 PMYep. I saw that even though I copy all the python code into the folder and pass that folder to the command line it falls back to the root/home directory. Hmm....
Yep. And that is huge, as it is the github runner homedir that checks out the whole repo which has other other ML model code that we don't want to package.
How do I tell it to not to that? 🙂
n
Niels Bantilan
03/06/2023, 7:58 PM@Kevin Su pyflyte fast registration should avoid packaging files that are in
.gitignorek
Kevin Su
03/06/2023, 8:49 PMcurrently all the file in the root folder will be packaged.
n
Niels Bantilan
03/06/2023, 9:22 PMhuh, doesn’t this https://github.com/flyteorg/flytekit/pull/899 take care of ignoring files in
.gitignore.dockerignorek
Kevin Su
03/06/2023, 10:20 PMsorry, I forgot this pr. yeah, .gitignore should work in pyflyte fast registration
k
Ketan (kumare3)
03/06/2023, 11:30 PM
it does, skip .gitignore and .dockerignore
n
Niels Bantilan
03/06/2023, 11:48 PMgreat! created this issue since our current registration docs doesn’t cover this: https://github.com/flyteorg/flyte/issues/3407
v
Vasu Upadhya
03/07/2023, 1:16 AMThanks All! That worked! Used the .dockerignore
ls -1a /home/runner | grep -wv app_module >> /home/runner/.dockerignorek
Ketan (kumare3)
03/07/2023, 5:03 AM
we are actually thinking of working on a customizable package / run / register command so that you can choose the package root