One other question: we're also planning on migrating the s3 bucket that Flyte uses to a new one, aft...

elegant-australia-91422

04/17/2024, 2:02 PM

One other question: we're also planning on migrating the s3 bucket that Flyte uses to a new one, after replicating all objects to the new bucket we hit the following issue after changing it in the helm chart:

Copy code

Conf container:old-flyte-bucket != Passed Container:new-flyte-bucket. Dynamic loading is disabled: not found

I'm seeing this line in the stow store: https://github.com/flyteorg/flyte/blob/1757750e580a0ff03fec877ba792a69825a3b720/flytestdlib/storage/stow_store.go#L187-L190 , and was wondering if it's possible to set

enableDynamicContainerLoading: true

somewhere in the helm charts?

elegant-australia-91422

04/17/2024, 2:10 PM

Ah, it looks like there's

storage.enableMultiContainer

https://github.com/flyteorg/flyte/tree/1757750e580a0ff03fec877ba792a69825a3b720/charts/flyte-core#:~:text=storage.enableMultiContainer

👍 1

👍🏽 1

average-finland-92144

04/17/2024, 5:10 PM

that's the flag. let us know if that works fine for you

elegant-australia-91422

04/17/2024, 5:32 PM

Yep, that did the trick ✔️ . Thank you @average-finland-92144!

🙌🏽 1

elegant-australia-91422

04/17/2024, 5:45 PM

We’re doing a DB and bucket migration, and the bucket steps seem sane but didn’t seem like we could do the DB migration without taking a downtime window

3 Views

Open in Slack

Previous Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.