Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<@U06RKAMK0UC> I am using FlyteFiles to upload to an s3 bucket, can I change where the metadata files are being written

Yes, you can configure separate backends for metadata and user data in Flyte. According to <https://docs.flyte.org/en/latest/user_guide/concepts/main_concepts/data_management.html#data-flow-and-security|Flyte's data management documentation>, metadata is managed within Flyte's control plane, while raw data is stored in an external blob store. To change where metadata files are written, you can adjust the storage configuration in Flyte's deployment settings. This involves specifying different storage endpoints for metadata and user data in the Flyte configuration files.

Would you like more detail on how to configure this? 

Sources:
- <https://docs.flyte.org/en/latest/user_guide/concepts/main_concepts/data_management.html#data-flow-and-security|Flyte Data Management> :+1: 1 button :-1: 0 button :bulb: *Hint:* Mention <@U06RKAMK0UC> in the thread for followups.