https://flyte.org
Join Slack
Is there a way to configure the storage location/prefix for code when using the new fast registratio...
# announcements
b
Is there a way to configure the storage location/prefix for code when using the new fast registration without bucket credentials? It used to be stored under 
bucket-name/fast/
before (not sure if I had configured it before, I can't find any config related to that). Now it's just stored in random paths under the bucket root.
f
But the storage location is where Flyte stores all it's metadata
b
That's fine, I just want to have it under a prefix, not the bucket root
Hmm perhaps I misunderstood how this works. If I set 
storagePrefix: fast
, flyte still creates random directories at the root of the bucket, and THEN prepends the prefix like: 
<gs://bucket/jl/fast/project/domain/><random>/<random>.tar.gz
Using an absolute prefix 
storagePrefix: "<gs://bucket/fast>"
doesn't work either.
f
Ya we can stop doing the random can you file an issue
It's using the same sharded
b
Ok I'll create an issue
I realized my issue is just about the prefix order, not sure about the random so I left that out for now. Here’s the issue: https://github.com/flyteorg/flyte/issues/2545
171 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by