I know resource based overrides work with

map_task

but the newer feature of overriding

container_image

doesn't seem to work with map_tasks. Here's a minimal example where its still using the default container image and not the overwritten one. It does work with regular tasks, just not map_task?

@task
def my_mappable_task(a: int) -> typing.Optional[str]:
    return str(a)

@workflow
def my_map_wf(x: typing.List[int]) -> typing.List[typing.Optional[str]]:
    return map_task(
        my_mappable_task,
        concurrency=10,
        min_success_ratio=0.75,
    )(a=x).with_overrides(container_image="random:image")

cc @Kevin Su since he added the original feature https://github.com/flyteorg/flytekit/commit/eafcc820303367749e63edc62190b9153fd6be5e

made a bug for this: https://github.com/flyteorg/flyte/issues/4493

Thank you for opening an issue. @Laura Lin I’ll create a PR later today

Thanks for giving this your attention, Kevin!

just created a PR. https://github.com/flyteorg/flytekit/pull/2011

Looking forward to using this feature as soon as it gets to a release, thanks for the quick turnaround Kevin!

@Gopal Vashishtha could you help me test it on your side?

pip install git+<https://github.com/flyteorg/flytekit.git@7a30eb575e38a75a6311ab534ff8806304a1dd93>

Just tested, yes it works!

nice, thank you. will merge it soon

Saw the change went in, that's awesome! Is it possible to remove the upper bound on

fsspec

that you introduced in this PR? We're getting a dependency conflict with another library that we are unable to resolve

which version of fsspec you are using

we're actually not using fsspec at all