ambitious-businessperson-90319
08/14/2024, 2:31 PMhigh-accountant-32689
08/14/2024, 4:14 PMwith_runtime_overrides
, can you talk a bit more about how you're registering the tasks/workflows?
I'm thinking that maybe you're being hit by https://github.com/flyteorg/flytekit/pull/2151. Assuming that you're using pyflyte
to register your code, can you pass -v
and confirm that you're seeing that warning?ambitious-businessperson-90319
08/14/2024, 5:57 PMmy_task().with_overrides(limits=Resources(cpu="2", mem="4Gi"))
Calling pyflyte -v run --remote does not show that warning lineambitious-businessperson-90319
08/14/2024, 6:06 PMfrom flytekit import task, workflow, Resources
from example.example_task import task_in_another_file
@task(
requests=Resources(mem="1Gi"),
limits=Resources(mem="1Gi"),
)
def task_in_same_file(
word: str,
) -> str:
return f"Example {word}"
@workflow
def simple_workflow(word: str) -> str:
word_result = task_in_same_file(word=word).with_overrides(
requests=Resources(mem="2Gi"),
limits=Resources(mem="2Gi"),
)
word_result2 = task_in_another_file(word=word_result).with_overrides(
requests=Resources(mem="2Gi"),
limits=Resources(mem="2Gi"),
)
return word_result2
example_task.py
from flytekit import task, Resources
@task(
requests=Resources(mem="1Gi"),
limits=Resources(mem="1Gi"),
)
def task_in_another_file(
word: str,
) -> str:
return f"Example {word}"
Command:
pyflyte -v run -p mlplatform -d public --copy-all --remote example/example_workflow.py simple_workflow --word my_word
Looking at the admin page for both versions of the task I see the non overriden values:high-accountant-32689
08/15/2024, 1:27 AMambitious-businessperson-90319
08/15/2024, 2:25 AM