https://flyte.org logo
#ask-the-community
Title
# ask-the-community
r

Robert Deaton

10/23/2023, 11:18 PM
Hi all, I'm looking to configure a few settings (in particular, GCS bucket used for metadata storage) on a per-project basis. I did a little bit of searching around and found https://flyte-org.slack.com/archives/CP2HDHKE1/p1694530252928899?thread_ts=1694517922.705899&cid=CP2HDHKE1 from @Ketan (kumare3) which sounds like what I want, but I haven't been able to find anything in the docs or slack for how I would make per-project settings. Any pointers would be much appreciated.
s

Samhita Alla

10/25/2023, 5:11 AM
@David Espejo (he/him), I searched the repo and docs but haven't found anything concrete. Do you have any idea how to set up a metadata bucket per project-domain?
d

David Espejo (he/him)

10/25/2023, 9:50 PM
@Robert Deaton The closest I can find is the ability to specify a different bucket per Workflow, using
raw_output_data_config
as part of a LaunchPlan (see https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.LaunchPlan.html#flytekit-launchplan) I tried with Cluster Resource Attribute with no luck
k

Ketan (kumare3)

10/26/2023, 6:19 AM
Per project you can do I will share an example tomorrow
And we can add to docs cc @Samhita Alla
s

Samhita Alla

10/26/2023, 6:25 AM
You can update the workflow execution config as specified in this doc. Example configuration:
Copy code
domain: development
project: flytesnacks
raw_output_data_config:
  output_location_prefix: <s3://my-s3-bucket>