https://flyte.org logo
#ray-integration
Title
# ray-integration
n

Nandakumar Raghu

09/13/2023, 9:58 AM
Hi, we are executing ray tasks from flyte and we want to link the ray dashboard on the task UI. Ray automatically creates an ingress and we are able to access the dashboard by looking at the ingress details, but not sure how to get this on the flyte UI. Any ideas? We can access the ray dashboard like so - http://<some-code>.elb.eu-central-1.amazonaws.com/*atvxdf4jvppwptx6ss9w-n0-0*-raycluster-j7xhw/
k

Ketan (kumare3)

09/13/2023, 1:16 PM
It should be possible to add this to the Flyte backend plugin so that you can get a UI link
f

Franco Bocci

09/13/2023, 1:36 PM
Hey! One doubt here. Are you re-using the same Ray cluster for all your tasks? Or using the integration in the way where it spins up a Ray cluster for each workflow?
k

Ketan (kumare3)

09/13/2023, 1:37 PM
I think it’s the dynamic cluster spin up - as that’s the integration in Flyte else you will have to run in client mode
f

Franco Bocci

09/13/2023, 1:38 PM
I did not know that created an ingress for the dashboard; thought port-forwarding was the only way
k

Ketan (kumare3)

09/13/2023, 1:39 PM
Ingresses are expensive- but I think that could be the kuberay operator
n

Nandakumar Raghu

09/13/2023, 1:46 PM
Yes, flyte spins up a new cluster for a ray task. I think there is a setting for shutdown delay to make sure the cluster is deleted. And yes, the ingress is also created when a ray job is launched through flyte. Kuberay has a enableIngress setting which is set to true by the plugin before launching the job.
f

Franco Bocci

09/13/2023, 1:47 PM
Nice, was not aware. Thanks for this
n

Nandakumar Raghu

09/13/2023, 1:51 PM
@Ketan (kumare3) - We do have this in our values.yaml -
Copy code
plugins:
      logs:
        templates:
          - displayName: Datadog
            templateUris:
              - <https://app.datadoghq.eu/logs?query=pod_name%3A{{> "{{" }}.podName{{ "}}" }}%20container_name%3A{{ "{{" }}.containerName{{ "}}" }}&from_ts=1672527600000
            messageFormat: 0
This works for normal tasks, but does not display the logs link for a RayTask. Also, how do we add a specific templateUri for a specific type of task like a RayTask? i.e it should show up only for the RayTask not others?
2 Views