I have a training pipeline running in the cluster demo, but somehow after succesfully run the train task, I can't access the checkpoint path from the next task because the directory is not exists. I use a custom container to run the workflow, it works locally but not working in the cluster

would you mind sharing your code?

I'm able to solve it. I have to use the FlyteDirectory or FlyteFile to share files/folders between tasks. Did you explain in the documentation that each task has its own working directory context and have to use FlyteDirectory/FlyteFile in order to share files/dirs between tasks?

i think we did! flytefile and directory need to be used to share files/directories between the tasks.

I don't think I see that, can you provide documentation?

Ah i see, I think I missed that one