high-park-82026
jolly-florist-66728
09/18/2024, 4:31 PMFlyteDirectory
instead of using the randomly generated path. You can specify the remote_path
parameter when returning a FlyteDirectory
object. This allows you to control where the directory contents are uploaded in your S3 bucket.
Here's an example:
from flytekit import task, FlyteDirectory
@task
def process_files() -> FlyteDirectory:
local_dir = "/path/to/local/dir"
remote_path = "s3://your-bucket/specific/path/"
return FlyteDirectory(local_dir, remote_path=remote_path)
According to the FlyteDirectory documentation, if you provide a remote_path
, the contents of the local directory will be uploaded to the specified S3 path.
Would you like more details on this or any other aspect of Flyte?
Sources:
- FlyteDirectory documentation 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.