Question for the crowd - has anyone performed a backup / restore of Flyte blob storage from one bucket to another?
As it stands, the metadata bucket is full of protobuf files which contain fully qualified paths like s3://my-data-bucket/foo to actual inputs / outputs in the data bucket. Moving to another bucket would therefore require parsing / rewriting all the protobuf files, unless I'm missing something?
h
high-accountant-32689
06/27/2024, 6:35 PM
No, you're absolutely right.
high-accountant-32689
06/27/2024, 7:02 PM
Unfortunately we never invested in a tool to help such migration.