Hey folks. I have a Ray Cluster running on GCP and...
# ray-integrationp
Petr Pilař
08/31/2023, 3:37 PMHey folks. I have a Ray Cluster running on GCP and am relatively new to MLOps -- from reading this blog post https://flyte.org/blog/ray-and-flyte I did not fully grasp the benefits of running Ray inside Flyte -- can some users of both explain the benefits to me?
k
Ketan (kumare3)
08/31/2023, 4:11 PM
i think the benefits are ephemeral cluster
• Automatic setup and teardown cluster
• Cluster has all your python dependencies installed and is reproducible
• you can create one cluster per execution / per user and they can be independent
Ketan (kumare3)
08/31/2023, 4:12 PM
But, you do not have to use Flyte and KubeRay clusters
Ketan (kumare3)
08/31/2023, 4:12 PM
we infact will be working with Anyscale and others to add Flyte Agent support to send workloads to existing kubernetes clusters
Ketan (kumare3)
08/31/2023, 4:12 PM
how do you manage the lifecycle of the clusters across multiple users?
p
Petr Pilař
08/31/2023, 4:13 PMMy usecase is maybe a bit different, there are no users other than my service, which launches predefined jobs on the cluster.
Petr Pilař
08/31/2023, 4:13 PMSo Ray itself is never exposed to the users.
k
Ketan (kumare3)
08/31/2023, 4:15 PM
and you want the cluster to be up all the time?
p
Petr Pilař
08/31/2023, 4:15 PMYeah, ideally:)
k
Ketan (kumare3)
08/31/2023, 4:15 PM
if so, I think adding a Flyte Agent would be easy or run Ray in client mode
Ketan (kumare3)
08/31/2023, 4:16 PM
the Flyte Ray job is for emphemeral, isolated and potentially "short" lived clusters
Ketan (kumare3)
08/31/2023, 4:16 PM
p
Petr Pilař
08/31/2023, 4:24 PMI see -- makes sense! Thanks for the advice
k
Ketan (kumare3)
08/31/2023, 4:29 PM
or simply run the ray head node in client mode in a flyte pod
k
Kevin Su
08/31/2023, 5:00 PMcc @Yicheng Lu Ray agent
y
Yicheng Lu
08/31/2023, 6:52 PMworking on it
5 Views