Hi, I came across

with_override

feature in flytekit. The example demonstrate overriding task’s cpu & memory limits.

@workflow
def my_pipeline(x: typing.List[int]) -> int:
    return square_1(x=count_unique_numbers_1(x=x)).with_overrides(
        limits=Resources(cpu="6", mem="500Mi")
    )

Can it be done by using workflow input. e.g.

@workflow
def my_pipeline(x: typing.List[int], cpu: str, mem: str) -> int:
    return square_1(x=count_unique_numbers_1(x=x)).with_overrides(
        limits=Resources(cpu=cpu, mem=mem)
    )

?

Hey @most-gold-65483, we plan to support generic override resource, so most of the resource config can be overridden at execution time Just like overriding role and service account. Here is an example

Oh ok, I thought the word

dynamically

here refers to execution overrides. Thanks for clarifying!

You can do it in a dynamic workflows

We’d love the functionality described above as well! (also described in the feature request)!

Please help with specing it out