So looks like I can manually add the project root to PYTHONPATH, but when I do that,

pyflyte package

errors out with

Multiple definitions of the following tasks were found

for all tasks. I can confirm that without setting PYTHONPATH, the command runs successfully without issues.