https://flyte.org logo
#ask-the-community
Title
# ask-the-community
s

Stefan Avesand

07/13/2022, 1:57 PM
Has anyone tried running Dask together with Flyte?
k

Ketan (kumare3)

07/13/2022, 2:00 PM
@Stefan Avesand great timing, infact folks from Pachama do this and they are kind enough to upstream the plugin https://github.com/flyteorg/flyteplugins/pull/275
🙏 1
s

Stefan Avesand

07/13/2022, 2:01 PM
Amazing!
b

Bernhard Stadlbauer

07/13/2022, 2:17 PM
@Stefan Avesand Hi from over here at Pachama 🙂 Happy to share the approach we're using at the moment (with a
flytekit
"pure python" plugin), until the work on the backend plugin is finished. Also feel free to send me a DM if you have any further questions
❤️ 1
s

Stefan Avesand

07/13/2022, 2:18 PM
That would be great!
b

Bernhard Stadlbauer

07/13/2022, 2:22 PM
I'll try to get a PR out sometime this week for the flytekit plugin, @Ketan (kumare3) I might do this in a separate repository, as the backend plugin will soon also have a
flytekit
PR?
👍 1
r

Rahul Mehta

07/13/2022, 10:57 PM
@Bernhard Stadlbauer also very interested in what a pure python plug-in might look like!
k

Ketan (kumare3)

07/13/2022, 11:25 PM
@Rahul Mehta you should be able to do everything in pure python right - with the right service account?
👍 1
r

Rahul Mehta

07/13/2022, 11:25 PM
Ahh ofc @Ketan (kumare3), makes sense
b

Bernhard Stadlbauer

07/17/2022, 8:46 PM
@Stefan Avesand @Rahul Mehta @Ketan (kumare3) Sorry that this took a little longer, but I've packaged up the initial
flytekit
dask
code now into this repository. I've also released it to PyPi, so you should be able to install it with
Copy code
pip install bstadlbauer.flytekitplugins-dask
Let me know if there are any issues, feature requests, etc. 🙂
❤️ 2
s

Stefan Avesand

07/18/2022, 8:24 AM
That's great! Can't wait to try it out.
31 Views