cuddly-jelly-27016
09/13/2023, 9:56 PM@eager decorator to support running the workflow locally but executing tasks/subworkflows remotely. Also adds support and tests for preserving offloaded types.
Type
☐ Bug Fix
☑︎ Feature
☐ Plugin
Are all requirements met?
☑︎ Code completed
☑︎ Smoke tested
☑︎ Unit tests added
☑︎ Code documentation added
☑︎ Any pending items have an associated Issue
Complete description
@eager(local_entrypoint=True) will treat the eager workflow as a locally executed task that invokes the configured remote object for tasks and subworkflows called inside of it. It also adds support and tests for offloaded types: structured datasets, files, and directories, such that they are not immediately downloaded and can be downloaded/iterated over in the eager workflow function body.
This PR also fixes some formatting issues with the eager workflow flyte deck.
Tracking Issue
NA
Follow-up issue
NA
flyteorg/flytekit
GitHub Actions: build (macos-latest, 3.11)
GitHub Actions: build (macos-latest, 3.10)
GitHub Actions: build (macos-latest, 3.9)
GitHub Actions: build (macos-latest, 3.8)
GitHub Actions: build (windows-latest, 3.11)
GitHub Actions: build (windows-latest, 3.9)
GitHub Actions: build (windows-latest, 3.8)
GitHub Actions: build (ubuntu-latest, 3.11)
GitHub Actions: build (ubuntu-latest, 3.10)
GitHub Actions: build (ubuntu-latest, 3.9)
GitHub Actions: build (ubuntu-latest, 3.8)
GitHub Actions: docs
GitHub Actions: build-integration (ubuntu-latest, 3.10)
GitHub Actions: build-integration (ubuntu-latest, 3.9)
GitHub Actions: build-integration (ubuntu-latest, 3.8)
GitHub Actions: Docs Warnings
GitHub Actions: lint
✅ 2 other checks have passed
2/19 successful checksacoustic-carpenter-78188
09/18/2023, 7:45 PM