Hi all, I'm looking to configure a few settings (i...
# ask-the-community
r
Hi all, I'm looking to configure a few settings (in particular, GCS bucket used for metadata storage) on a per-project basis. I did a little bit of searching around and found https://flyte-org.slack.com/archives/CP2HDHKE1/p1694530252928899?thread_ts=1694517922.705899&cid=CP2HDHKE1 from @Ketan (kumare3) which sounds like what I want, but I haven't been able to find anything in the docs or slack for how I would make per-project settings. Any pointers would be much appreciated.
s
@David Espejo (he/him), I searched the repo and docs but haven't found anything concrete. Do you have any idea how to set up a metadata bucket per project-domain?
d
@Robert Deaton The closest I can find is the ability to specify a different bucket per Workflow, using
raw_output_data_config
as part of a LaunchPlan (see https://docs.flyte.org/projects/flytekit/en/latest/generated/flytekit.LaunchPlan.html#flytekit-launchplan) I tried with Cluster Resource Attribute with no luck
k
Per project you can do I will share an example tomorrow
And we can add to docs cc @Samhita Alla
s
You can update the workflow execution config as specified in this doc. Example configuration:
Copy code
domain: development
project: flytesnacks
raw_output_data_config:
  output_location_prefix: <s3://my-s3-bucket>