#3413 [Flytekit-7005] Adding ray autoscaler options
Pull request opened by
0yukali0
Tracking issue
Ralated
7005
Why are the changes needed?
Ray plugin in Flytekit does not support ray autoscaler option when enable_autoscaling is settable.
What changes were proposed in this pull request?
1. Create autoscaler option dataclass
2. Add that to ray cluster message which sent to backend.
How was this patch tested?
Setup process
clone flyte and flytekit (branch flyte-7005 and flytekit-7005)
run the flyte backend in sandbox
2.1 flytectl demo start --dev
2.2 make compile && POD_NAMESPACE=flyte ./flyte start --config flyte-single-binary-local.yaml
Update ray example like
Ray example
3.1 uv venv -p 3.11 && source .venv/bin/activate && uv pip install -e ~/flytekit ~/flytekit/plugins/flytekit-ray && uv pip install -e ~/flyte/flyteidl
3.2 "pyflyte run --remote ray_example.py ray_workflow --n 10"
Screenshots
image image
Check all the applicable boxes
• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.
Related PRs
Docs link
flyteorg/flytekit