https://flyte.org logo
  • Bernhard Stadlbauer

    Bernhard Stadlbauer

    1 month ago
    Hi! I am working on a dask propeller plugin at the moment, which might be related to this. I wanted to give you a quick update on what has happened so far as the work might be related: • I've started a small repo creating a Go client for the k8s dask operator • I've started adding a flyteplugins branch which adds the plugin. At the moment, there is a very rough draft which uses the 
    DaskJob
    resource (similar to the 
    SparkApplication
    resource) to deploy the cluster and run the code • I've started a flytekit branch, which at the moment only has a minimal skeleton which enables testing the created backend plugin All of this is still on the POC level (things will be refactored/test added, etc.), but I would like to slowly progress this to have an MVP over the upcoming weeks. Have a nice day 🙂
    👍 2❤️ 5
  • cc @Ketan (kumare3)