hi everyone, does flyte2 support gke autopilot?
# flyte-v2-support
r
hi everyone, does flyte2 support gke autopilot?
b
Hi @rapid-appointment-17222 We haven’t tested this yet, but yes, it should work. Nothing in Flyte 2 needs node-level access: the control plane is a single Deployment, task pods are plain pods, and the secrets webhook is scoped by label so it never touches GKE-managed namespaces. GPU config already uses GCP accelerator names, you just set gpu-device-node-label: cloud.google.com/gke-accelerator. There’s one default you’ll want to override: Flyte annotates every task pod with cluster-autoscaler.kubernetes.io/safe-to-evict: “false”. On Autopilot that requests an extended-run-time pod, which caps you at 50 such workloads per cluster, raises the enforced resource minimums, rules out Spot, and tries to put each pod on its own node. Drop it from k8s.default-annotations and apply it selectively if you need it. Other things to consider: • Autopilot enforces a CPU:memory ratio (1:1 to 1:6.5 on general-purpose) and caps ephemeral storage at 10GiB per pod, which matters for tasks staging large inputs locally. • Since every pod can trigger node provisioning, heavy map-task fan-out will be slower and pricier than on Standard node pools. I’d suggest Autopilot for the control plane and lighter workloads, The standard deployment for fan-out heavy projects. As I mentioned we don’t test against Autopilot in CI, so this is from reading the code against GKE’s restrictions rather than a deployment we’ve run. Would you be open to try it? We’d love to work with you on getting a docs guide for this
🔥 1
r
@broad-monitor-993 thanks! appreciate the detail here. i'll give it a go and get back to you 🙂
@broad-monitor-993 just following up here, seems to work! there's a few bugs i've noticed, what's the turnaround time typically on prs getting reviews. hoping to contribute where needed
b
we generally review pretty quickly
within a day or two
r
have had this pr open for a while. is there a process that contributors need to follow to get things reviewed?
b
hi @rapid-appointment-17222 will ping the team
hey @glamorous-carpet-83516 @faint-pilot-24699 can y’all take a look at github.com/flyteorg/flyte/pull/7910?
👀 1
f
Will take a look
b
@rapid-appointment-17222 feel free to ping one of us directly, you can also check off this box at the bottom of the text box so it shows up in the thread.
👍 1
You can also post in #C04NJPLRWUX as well
r
thanks @broad-monitor-993! will x-post as well in future
f
@rapid-appointment-17222 Do you mind that I commit to your PR directly? Will need to do some rebase and refactor.
r
@faint-pilot-24699 sorry about the delay here, yes please do!
it would be great if we could get that pr merged as well