Flyte itself does not handle node autoscaling directly; this is managed by Kubernetes. FlytePropeller, the engine driving Flyte workflows, can be horizontally scaled using a FlytePropeller Manager, which handles the automatic scaling of FlytePropeller instances based on a sharding strategy (
FlytePropeller Horizontal Scaling).
For node autoscaling, you need to set up Kubernetes tools like Cluster Autoscaler or Karpenter (
Flyte Community Discussion). Flyte manages back pressure and resource allocation through Kubernetes, but the actual scaling of nodes is handled by Kubernetes itself.
Would you like more detail on any specific aspect of Flyte's autoscaling?
Sources:
-
FlytePropeller Horizontal Scaling
-
Flyte Community Discussion 👍 1 button 👎 0 button 💡
Hint: Mention
@ancient-wolf-19325 in the thread for followups.