• Ketan (kumare3)

    Ketan (kumare3)

    3 months ago
    cc @Yee / @Sahil Khanna
  • Ketan (kumare3)

    Ketan (kumare3)

    3 months ago
    cc @Yee
  • Bernhard Stadlbauer

    Bernhard Stadlbauer

    3 months ago
    Hi! I am working on a dask propeller plugin at the moment, which might be related to this. I wanted to give you a quick update on what has happened so far as the work might be related: • I've started a small repo creating a Go client for the k8s dask operator • I've started adding a flyteplugins branch which adds the plugin. At the moment, there is a very rough draft which uses the
    DaskJob
    resource (similar to the
    SparkApplication
    resource) to deploy the cluster and run the code • I've started a flytekit branch, which at the moment only has a minimal skeleton which enables testing the created backend plugin All of this is still on the POC level (things will be refactored/test added, etc.), but I would like to slowly progress this to have an MVP over the upcoming weeks. Have a nice day 🙂
    Bernhard Stadlbauer
    1 replies
    Copy to Clipboard
  • Yee

    Yee

    2 months ago
    @Keshi Dai updated the doc with the things that we discussed yesterday. left one place for you to add some examples.
    Yee
    Keshi Dai
    +1
    18 replies
    Copy to Clipboard
  • Keshi Dai

    Keshi Dai

    2 months ago
    @Ketan (kumare3) @Yee regarding the KubeRay community demo, it seems tomorrow’s agenda will be pretty packed according to @Jiaxin Shan for KubeRay 0.3 release. Are you guys OK with moving to the one on July 26? @Jiaxin Shan could you please help confirm that there’ll be a slot available for the sync on July 26?
    Keshi Dai
    Yee
    2 replies
    Copy to Clipboard
  • j

    Jiaxin Shan

    2 months ago
    I can confirm the availability on July 26. If Flyte team can move demo to July 26, that would be great.
  • Yee

    Yee

    2 months ago
    @Keshi Dai @Jiaxin Shan - so we’re on for the 26th right? we’re gonna start work on the presentation tomorrow.
    Yee
    j
    +1
    13 replies
    Copy to Clipboard
  • Ketan (kumare3)

    Ketan (kumare3)

    2 months ago
    Great job @Yee : @Kevin Su and thank you @Keshi Dai
    Ketan (kumare3)
    Keshi Dai
    4 replies
    Copy to Clipboard
  • Yee

    Yee

    2 months ago
    @Keshi Dai - these are the Ray PRs we’re working on. https://github.com/flyteorg/flyteidl/pull/308 https://github.com/flyteorg/flytekit/pull/1093 https://github.com/flyteorg/flyteplugins/pull/279 responding to your comment on the first one, but mind taking a quick look at the other two as well?
    Yee
    Keshi Dai
    +1
    31 replies
    Copy to Clipboard