Trying to integrate Ray and Flyte and I m running into this Flyte #flyte-support

Trying to integrate Ray and Flyte and I’m running ...

curved-whale-1505

06/14/2025, 4:57 PM

Trying to integrate Ray and Flyte and I’m running into this error:

Copy code

File "/tmp/ray/session_2025-06-14_16-47-27_250220_1/runtime_resources/pip/14a3daa1f865c8d76d1b356d563406ae44a38d58/virtualenv/lib/python3.11/site-packages/flytekit/core/data_persistence.py", line 614, in async_get_data
    raise FlyteDownloadDataException(
flytekit.exceptions.system.FlyteDownloadDataException: SYSTEM:DownloadDataError: error=Failed to get data from <s3://mybucket/flytesnacks/development/NF2PQ3P4WNNOVWDFEX6OAYWBD4======/fast9ba0043893d5986322db7a23c8d8bbd0.tar.gz> to ./ (recursive=False).

Original exception: Unable to locate credentials

I’m running the example as describe in this document: https://www.union.ai/docs/flyte/integrations/native-backend-plugins/ray-plugin/ray-example/ And I installed ray on the cluster as described in this document: https://docs.flyte.org/en/latest/deployment/plugins/k8s/index.html#deployment-plugin-setup-k8s What am I missing to do here?

curved-whale-1505

06/14/2025, 8:09 PM

I think its related to this issue: https://github.com/ray-project/kuberay/issues/242 I see the service account of the head node has the same name as the new ray cluster. The new dynamically created SA doesn’t have permissions to access S3 I’m confused why I’m running into this using the flyte ray example out of the box

curved-whale-1505

06/14/2025, 8:17 PM

if I set

enable_autoscaling=False

, the example works properly and the

default

SA gets used

7 Views

Open in Slack

Previous Next