late-fish-63527
@task(requests=Resources(cpu="1", mem="4Gi"), limits=Resources(cpu="2", mem="32Gi")) def hello_world(): print('hello world') hello_world._resources = ResourceSpec(requests=Resources(cpu='1', mem='16Gi', gpu=None, storage=None, ephemeral_storage=None), limits=Resources(cpu='2', mem='32Gi', gpu=None, storage=None, ephemeral_storage=None))
freezing-airport-6809
My recommendation would be to make the resources as like a concertant or a module level variable
REQUESTS=Resources(cpu='1', mem='16Gi') LIMITS=Resources(cpu='1', mem='16Gi') @task(requests=REQUESTS, limts=LIMITS) def hello_world(): print('hello world')
if os.environ["XYZ"] == "blah": REQUESTS = ... else: REQUESTS = ...
Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.