Hi team,
anybody here running Flyte and GPU workloads on a self-managed K8s cluster (on-prem/cloud)?
Would love to get in touch! I'm interested to learn more about your approaches to maximize GPU utilization, reduce cost and do smarter allocation of resources to workloads. Talking to others we see that the avg. utilization of GPU resources is around 35-40%.
Thank and best
Robin