#4187 Add Ray Autoscaler to the Flyte-Ray plugin.
Issue created by
Yicheng-Lu-llll
Motivation: Why do you think this is important?
Currently, the Flyte-Ray plugin utilizes Rayjob. However, there are cases where Rayjob may require an autoscaler.
For instance, after completing a workload with Rayjob, a user might want to retain all the information, logs, past tasks, and actor execution history for a period. As of now, Ray lacks a mechanism to persist these data, necessitating the continuous operation of the Ray cluster even after workload completion. With an autoscaler, the Ray cluster will maintain only the head pod while scaling down all worker pods.
Goal: What should the final outcome look like, ideally?
Have config to enable Ray Autoscaler.
Describe alternatives you've considered
None
Propose: Link/Inline OR Additional context
None
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyte