Hi! I am working on a <dask> propeller plugin at ...
# ray-on-flyte
a
Hi! I am working on a dask propeller plugin at the moment, which might be related to this. I wanted to give you a quick update on what has happened so far as the work might be related: • I've started a small repo creating a Go client for the k8s dask operator • I've started adding a flyteplugins branch which adds the plugin. At the moment, there is a very rough draft which uses the
DaskJob
resource (similar to the
SparkApplication
resource) to deploy the cluster and run the code • I've started a flytekit branch, which at the moment only has a minimal skeleton which enables testing the created backend plugin All of this is still on the POC level (things will be refactored/test added, etc.), but I would like to slowly progress this to have an MVP over the upcoming weeks. Have a nice day 🙂
👍 2
❤️ 5
cc @freezing-airport-6809