Hi Folks, was just wondering if Flyte supports gan...
# flyte-supportd
damp-toddler-31924
07/06/2023, 6:23 PMHi Folks, was just wondering if Flyte supports gang scheduling in order to run multi-node training as part of a workflow?
f
freezing-airport-6809
07/06/2023, 6:29 PM
You can use any scheduler in concert with Flyte for example - yunikorn, volcano or kqueue - some folks use some of these
d
damp-toddler-31924
07/06/2023, 6:32 PMAwesome! Do you happen to have any documentation or examples available for this?
f
freezing-airport-6809
07/06/2023, 7:20 PM
No docs at the moment/ but use pod templates
freezing-airport-6809
07/07/2023, 5:27 AM
I think there was a recent thread on this and @cool-lifeguard-49380 and team uses one
c
cool-lifeguard-49380
07/07/2023, 8:00 AMWe use “scheduling plugins” and are happy with it. I noted the steps to get this working here. Let me know if you need help with this.
f
freezing-airport-6809
07/08/2023, 6:24 AM
@cool-lifeguard-49380 want to make a doc PR for this 😍
c
cool-lifeguard-49380
07/08/2023, 10:10 AMcool-lifeguard-49380
07/08/2023, 10:11 AMThe version constraint is not there anymore, training operator updated their reqs.
cool-lifeguard-49380
07/08/2023, 10:11 AMBtw could I please have the permissions to create prs directly in the flyte repo? Used a fork now but in the other repos i can
cool-lifeguard-49380
07/08/2023, 10:11 AMthx
f
freezing-airport-6809
07/08/2023, 7:04 PM
Absolutely you should have permission
freezing-airport-6809
07/08/2023, 7:04 PM
@high-accountant-32689 / @thankful-minister-83577 can either of you add him?
h
high-accountant-32689
07/08/2023, 9:25 PMDone. You should have access now, @cool-lifeguard-49380.
c
cool-lifeguard-49380
07/10/2023, 7:57 AMthx!
117 Views