Is there a config somewhere I can set aws sse keys...
# flyte-deploymentb
Brian O'Donovan
10/11/2023, 6:03 PMIs there a config somewhere I can set aws sse keys for S3 operations on encrypted buckets?
k
Kevin Su
10/11/2023, 6:20 PMIIRC, it not exposed right now. let me create a pr shortly.
Kevin Su
10/11/2023, 7:39 PMcould you give it a try? https://github.com/flyteorg/flytekit/pull/1887/files
You need to update the default-env. add FLYTE_AWS_SERVER_SIDE_ENCRYPTION to the config
b
Brian O'Donovan
10/12/2023, 6:03 PMThank you, Kevin.
I actually have a ticket open with Union right now. We are having issues with a particular account/bucket that was SSE-S3 encrypted at first. Thinking that was problem, I removed the encryption on the bucket and we are still seeing the issue.
I will test drive this branch today if we don't land on a solution with the Union ticket though I don't think the SSE is the culprit right now
e
Ethan Brown
11/29/2023, 2:15 PMJust running into what looks to be the same issue in my environment -- we use SSE and I'm seeing a 403 when using
pyflyte run --remotehelm upgradeEthan Brown
11/29/2023, 2:21 PMLeft a comment on your PR @Kevin Su -- the setting needs to be more flexible than what you have defined
Ethan Brown
11/29/2023, 2:23 PMMLflow does this in a way that works -- https://mlflow.org/docs/latest/tracking.html#amazon-s3-and-s3-compatible-storage