Did anyone run into issue with Flyte retrieving it...
# ask-the-communityh
Haytham Amin
08/18/2023, 3:21 PMDid anyone run into issue with Flyte retrieving items from storage blob?
[1/1] currentAttempt done. Last Error: USER::load_distribution(additional_distribution, dest_dir) │
│ │
│ /usr/local/lib/python3.10/site-packages/flytekit/core/utils.py:295 in │
│ wrapper │
│ │
│ ❱ 295 │ │ │ │ return func(*args, **kwargs) │
│ │
│ /usr/local/lib/python3.10/site-packages/flytekit/tools/fast_registration.py: │
│ 113 in download_distribution │
│ │
│ ❱ 113 │ FlyteContextManager.current_context().file_access.get_data(additio │
│ │
│ /usr/local/lib/python3.10/site-packages/flytekit/core/data_persistence.py:30 │
│ 1 in get_data │
│ │
│ ❱ 301 │ │ │ raise FlyteAssertion( │
╰──────────────────────────────────────────────────────────────────────────────╯
FlyteAssertion: Failed to get data from
gs://flyte-blob-storage/flytesnacks/development/MHEQCB3WRLH247GOTRY3CZQIWE======
/fastea66e2416c583fdc6995e9e030c414bf.tar.gz to /root/ (recursive=False).
Original exception: 403, message='Forbidden',
url=URL('https://storage.googleapis.com/download/storage/v1/b/flyte-blob-storage
/o/flytesnacks%2Fdevelopment%2FMHEQCB3WRLH247GOTRY3CZQIWE======%2Ffastea66e2416c
583fdc6995e9e030c414bf.tar.gz?alt=media')
The https link seems to include extra entries which results in 403 error
k
Kevin Su
08/18/2023, 4:47 PMdoes you pod have permission to download the file?
h
Haytham Amin
08/18/2023, 5:17 PMSA has admin permissions on that storage bucket
Haytham Amin
08/18/2023, 5:17 PMbut I think the issue is with the URL as it does not match the actual URL for the object showing via GUI
Haytham Amin
08/18/2023, 5:18 PMthere is no /download/storage/v1/b/ in the path
k
Kevin Su
08/18/2023, 5:47 PMhave you changed container path?
Copy code
storage.yaml: |
storage:
type: s3
container: "my-s3-bucket" <- thisKevin Su
08/18/2023, 5:48 PMyou might have changed the default prefix somewhere in admin config map.
h
Haytham Amin
08/18/2023, 5:49 PMHow should this be for gce?
Haytham Amin
08/18/2023, 7:58 PMhere is my storage.yaml
Copy code
kubectl exec flyte-flyte-binary-75544db67f-rhwzp --namespace flyte -c flyte -- cat /etc/flyte/config.d/003-storage.yaml
propeller:
rawoutput-prefix: <gs://flyte-blob-storage/data>
storage:
type: stow
stow:
kind: google
config:
json: ""
project_id: flyte-com-dev-per-gke
scopes: <https://www.googleapis.com/auth/cloud-platform>
container: flyte-blob-storagek
Kevin Su
08/18/2023, 8:12 PMdo all the tasks fail with the same error?
Kevin Su
08/18/2023, 8:12 PMcc @Yee
h
Haytham Amin
08/18/2023, 8:12 PMyup
Haytham Amin
08/18/2023, 8:16 PMI also tried to change the type to gcs but that did not change the type in config file
84 Views