https://flyte.org logo
#flytekit
Title
# flytekit
p

Pradithya Aria Pura

02/24/2023, 7:17 AM
Hi, I came across
with_override
feature in flytekit. The example demonstrate overriding task’s cpu & memory limits.
Copy code
@workflow
def my_pipeline(x: typing.List[int]) -> int:
    return square_1(x=count_unique_numbers_1(x=x)).with_overrides(
        limits=Resources(cpu="6", mem="500Mi")
    )
Can it be done by using workflow input. e.g.
Copy code
@workflow
def my_pipeline(x: typing.List[int], cpu: str, mem: str) -> int:
    return square_1(x=count_unique_numbers_1(x=x)).with_overrides(
        limits=Resources(cpu=cpu, mem=mem)
    )
?
k

Kevin Su

02/24/2023, 10:21 AM
Hey @Pradithya Aria Pura, we plan to support generic override resource, so most of the resource config can be overridden at execution time Just like overriding role and service account. Here is an example
p

Pradithya Aria Pura

02/24/2023, 11:07 AM
Oh ok, I thought the word
dynamically
here refers to execution overrides. Thanks for clarifying!
k

Ketan (kumare3)

02/24/2023, 2:51 PM
You can do it in a dynamic workflows
g

Greg Gydush

02/24/2023, 8:55 PM
We’d love the functionality described above as well! (also described in the feature request)!
k

Ketan (kumare3)

02/25/2023, 5:32 AM
Please help with specing it out
67 Views