#165 Add item ID to the workqueue instead
Pull request opened by
pingsutw
TL;DR
I found that Propeller keeps sending the request to the agent even workflow is done.
The work queue only has unique items, so we add
itemID
to it. The workers won't process the item again after the task is done.
Before:
After:
100 workflows, each has 100 tasks.
Before:
After:
Type
☑︎ Bug Fix
☐ Feature
☐ Plugin
Are all requirements met?
☐ Code completed
☑︎ Smoke tested
☐ Unit tests added
☐ Code documentation added
☐ Any pending items have an associated Issue
Complete description
^^^
Tracking Issue
NA
Follow-up issue
NA
flyteorg/flytestdlib
GitHub Actions: Lint / Run Lint
GitHub Actions: Ensure go generate has run
GitHub Actions: Run tests
✅ 2 other checks have passed
2/5 successful checks