https://flyte.org
Join Slack
What's the best way to put a hard limit the number of pods that Flyte & SparkOperator will spin ...
# flyte-support
l
What's the best way to put a hard limit the number of pods that Flyte & SparkOperator will spin up? (let's say we have some vCPU limit of 100 or something)
f
Resourcequota
Flyte can also manage that
l
like this ?
Copy code
defaults:
    cpu: "1"
    memory: 150Mi
limits:
    cpu: "2"
    memory: 450Mi
project: flyteexamples
domain: development
f
No this is default cpu etc per task if unspecified and limits
l
Ah
this file for cluster resources
Copy code
attributes:
    projectQuotaCpu: "1000"
    projectQuotaMemory: 5TB
domain: development
project: flyteexamples
f
l
great thanks, just making sure that's the best way
💯 1
f
Ya it should be and Flyte should start respecting it
There is some stuff that community is working on
156 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by