Is there a way to specify the output path for the two implicit outputs for NotebookTask (Jupyter)? Essentially the desired workflow is to load in the source Jupyter notebook from EFS and then output the rendered HTML and output notebook to some sort of scratch/ephemeral storage so that the output file paths don't overlap during execution of parallel tasks.
Been running into some errors currently as the current papermill plugin appears to derive the output paths from the source file name and then appending "out.ipynb" and "out.html". It would be great if we could append a unique run ID to each outputted file and/or if we can manually the output path.
05/29/2023, 2:22 PM
This is being changed or there is a PR. Cc @Kevin Su