Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Also interested in this. I have seen discussion in here before about it

<https://github.com/flyteorg/flyte/issues/6238> There's this closed issue from <@U04664Z7H37>, so I'm assuming they might be able to tell you/us more :slightly_smiling_face:

I’ll get back to you tonight, busy atm, sorry :slightly_smiling_face:

Hey <@U06MPSVVAQL> <@U086ZKYTR32>,
I still need to merge <https://github.com/flyteorg/flytekit/pull/3243|this> PR in flytekit so that one can set the queue name annotation in the `@task` decorator. Merging this PR requires a flyteidl release. I've been running a flytekit version with this change for a while and flyte with kueue works together well I'd say. I don't really use any of the queuing features of kueue but rather it's integration with the <https://kueue.sigs.k8s.io/docs/admission-check-controllers/provisioning/|provisioning request api> which <https://cloud.google.com/kubernetes-engine/docs/how-to/provisioningrequest|works really well with gke>.
The only issue I came across is <https://github.com/kubernetes/autoscaler/issues/7321|this> issue with the GKE cluster autoscaler when you try to use provisioning requests with ephemeral volume claim templates.

<@U0265RTUJ5B> <@USU6W5ATA> <@UNR3C6Y4T> do you know when the next flyteidl release is planned (so that the tests in <https://github.com/flyteorg/flytekit/pull/3243> will pass)?

<@U086ZKYTR32> <@U06MPSVVAQL> please let me know if you have any further questions about using Flyte with Kueue.

I think we were planning a release next week.

is it ok to release a beta flyteidl for Fabio getting review in flytekit?
I can do the beta release
cc <@UNR3C6Y4T> <@U04H6UUE78B>

From my side we can also wait until next week but thank you :slightly_smiling_face:

Yeah, also willing to wait for an official release before trying it all out

just wanted to say I'd be really interested in this integration as well :smile:

Note that the PRs I contributed are not an integration with Kueue but a way to set labels/annotations in the `@task` decorator. With that, using flyte with kueue boils down to configuring a queue and setting its name in the task decorator as an annotation. No further coupling between flyte and kueue is needed.