acoustic-carpenter-78188
01/12/2023, 2:16 AMdask backend plugin (flytekitplugins-dask)
Type
☐ Bug Fix
☑︎ Feature
☐ Plugin
Are all requirements met?
☑︎ Code completed
☑︎ Smoke tested
☑︎ Unit tests added
☑︎ Code documentation added
☑︎ Any pending items have an associated Issue
Complete description
This adds the Python side of the dask backed plugin (links to the related PRs can be found in the linked issue below).
TODO before this can be merged:
After flyteorg/flyteidl#339 is merged:
☑︎ Make sure flytekit version is up to date in plugins/flytekit-dask/setup.py (needs to have buf protobufs)
☑︎ Make sure flyteidl version is up to date in plugins/flytekit-dask/setup.py (needs to support dask IDL)
☑︎ Add plugins/flytekit-dask/requirements.in and lock (on Linux)
☑︎ Add dask[distributed] to <http://doc-requirements.in|doc-requirements.in> and re-lock (on Linux)
☐ Check to make sure documentation looks ok
Tracking Issue
flyteorg/flyte#427
Follow-up issue
NA
flyteorg/flytekit
✅ All checks have passed
30/30 successful checksacoustic-carpenter-78188
01/12/2023, 2:16 AM