acoustic-carpenter-78188
09/07/2023, 12:36 AM@task(requests=Resources(cpu="1", mem="4Gi"), limits=Resources(cpu="2", mem="32Gi"))
def hello_world():
print('hello world')
hello_world._resources = ResourceSpec(requests=Resources(cpu='1', mem='16Gi', gpu=None, storage=None, ephemeral_storage=None), limits=Resources(cpu='2', mem='32Gi', gpu=None, storage=None, ephemeral_storage=None))
@freezing-airport-6809 recommends making the resources like a constant or a module level variable:
REQUESTS=Resources(cpu='1', mem='16Gi')
LIMITS=Resources(cpu='1', mem='16Gi')
@task(requests=REQUESTS, limits=LIMITS)
def hello_world():
print('hello world')
These resources constants can be customized too:
if os.environ["XYZ"] == "blah":
REQUESTS = ...
else:
REQUESTS = ...
For details, see https://flyte-org.slack.com/archives/CP2HDHKE1/p1652231703319939
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyteacoustic-carpenter-78188
09/07/2023, 12:36 AM