Hello all, I have a pretty deep repository with mu...
# ask-the-community
a
Hello all, I have a pretty deep repository with multiple tasks and workflows. When I am registering the entire repository with
pyflyte register
, it is taking up a lot of RAM ,sometimes crashing and is pretty slow. Is this expected behaviour. Also what is some best practices for registering such repository.
y
you should be able to split it up pretty easily. is that an option? (like multiple commands, each with a different parent folder) or do they import from each other internally anyways
a
I have saperated my tasks and workflows into saperate folders. Is it possible to register tasks and workflows saperately?
s
You can run
pyflyte register
command once for every parent folder.
a
so in my setup i have directories
/tasks
containing all the tasks and
/workflows
containing workflows. will this work in this case?
s
I assume you're importing tasks from the
tasks
directory in your
workflows
directory?
a
Yes exactly
s
If workflows is dependent on tasks directory, you'll need to register all of them at a time. @Yee, what's the best practice to register in this case?