Hello all, I have a pretty deep repository with multiple tasks and workflows. When I am registering the entire repository with

pyflyte register

, it is taking up a lot of RAM ,sometimes crashing and is pretty slow. Is this expected behaviour. Also what is some best practices for registering such repository.

you should be able to split it up pretty easily. is that an option? (like multiple commands, each with a different parent folder) or do they import from each other internally anyways

I have saperated my tasks and workflows into saperate folders. Is it possible to register tasks and workflows saperately?

You can run

pyflyte register

command once for every parent folder.

so in my setup i have directories

/tasks

containing all the tasks and

/workflows

containing workflows. will this work in this case?

I assume you're importing tasks from the

tasks

directory in your

workflows

directory?

Yes exactly

If workflows is dependent on tasks directory, you'll need to register all of them at a time. @thankful-minister-83577, what's the best practice to register in this case?