#4138 Moving from flytestdlib - Add item ID to the workqueue instead
Pull request opened by
eapolinario
TL;DR
I found that Propeller keeps sending the request to the agent even workflow is done.
The work queue only has unique items, so we add
itemID
to it. The workers won't process the item again after the task is done.
Before:
After:
100 workflows, each has 100 tasks.
Before:
After:
Type
☑︎ Bug Fix
☐ Feature
☐ Plugin
Are all requirements met?
☐ Code completed
☑︎ Smoke tested
☐ Unit tests added
☐ Code documentation added
☐ Any pending items have an associated Issue
Complete description
^^^
Tracking Issue
NA
Follow-up issue
NA
flyteorg/flyte
GitHub Actions: Check for spelling errors
GitHub Actions: docs
✅ 2 other checks have passed
2/4 successful checks