#3525 [BUG] To override the sub workflow resources, with_overrides doesn’t work if there is a PythonInstanceTask inside it.
Issue created by
xshen8888
Describe the bug
def subwf():
t1()
t2()
def wf():
subwf()
t2 is failing for OOMKilled error with the default resource which is mem="4Gi".
I then override sub workflow's resources via with_overrides():
def wf():
subwf().with_overrides(requests=Resources(cpu="1", mem="30Gi"))
And t2 will execute successfully.
If I re-write t2 to be a class of PythonInstanceTask with no other code behavior changes, then t2 is still failing for OOMKilled, even if I have subwf().with_overrides(requests=Resources(cpu="1", mem="30Gi"))
Expected behavior
with_overrides() should work for PythonInstanceTask.
Additional context to reproduce
No response
Screenshots
No response
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyte