#275 Add dask plugin #patch Pull request opened by bstadlbauer TL;DR This PR adds a backend `dask` plugin using the `dask-kubernetes` operator to manage the

dask

cluster lifecycle. Type ☐ Bug Fix ☐ Feature ☑︎ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☑︎ Unit tests added ☑︎ Code documentation added ☑︎ Any pending items have an associated Issue Complete description The plugin works similar to the already existing

spark

plugin. It uses the

DaskJob

(docs) Custom Resource as a client pod which connects to the spun up cluster. This is similar to how the

SparkApplication

Custom Resource works for the

spark

plugin. TODO before this can be merged: ☐ Use correct

flyteidl

after flyteorg/flyteidl#339 is merged and released Tracking Issue flyteorg/flyte#427 Follow-up issue NA flyteorg/flyteplugins ✅ All checks have passed 6/6 successful checks