Reminder: This week's contributor's sync: • Thursd...
# contribute
e
Reminder: This week's contributor's sync: • Thursday, 11:00 a.m. PT • AgendaZoomImport calendar We hope to see you all there!
c
https://github.com/flyteorg/flyte/issues/6238 One issue I'd like to pitch in the next contrib sync: Since I've run into more stability issues with the gang scheduler we've been using, I've been exploring to use Kueue for gang scheduling. On GKE, I really like how it could be leveraged. Bonus, the required changes in flyte are minimal.
f
@cool-lifeguard-49380 gang scheduling to work correctly needs to be all or nothing
and for Kueue we found that it will heavily destablize the system as for every pod it creates a crd object
c
> gang scheduling to work correctly needs to be all or nothing Yes, that I agree with. I rewrote the issue to not focus on kueue/gang scheduling but simply allow more fine grained control over object metadata for flyte k8s plugin CRD objects (the same way one can already control metadata for normal pod tasks). I’d use this for kueue but it’s a general feature that can be used for any other integration needing labels/annotations as well.
and for Kueue we found that it will heavily destablize the system as for every pod it creates a crd object
I’d be very interested in learning more about your experience with it!