Swarup Srinivasan
06/29/2023, 5:43 PMParallelism
attribute as 5
but the workflow executed with more than 5 tasks in parallel. Are we misunderstanding the parallelism attribute or is there a bug here?Seth Hendrickson
06/29/2023, 5:45 PM@task
def simple_task(idx: int) -> str:
time.sleep(30)
return f"task{idx}"
@dynamic
def run_tasks(n: int) -> List[str]:
out = []
for i in range(n):
out.append(simple_task(i))
return out
@workflow
def cttx_labeling() -> List[str]:
return run_tasks(10)
Jay Ganbat
06/29/2023, 5:58 PMSwarup Srinivasan
06/29/2023, 6:07 PMRunning
phase concurrentlySeth Hendrickson
06/29/2023, 6:58 PMJay Ganbat
06/29/2023, 7:06 PMchunk_and_process_wf
is on holdSeth Hendrickson
06/29/2023, 9:08 PMSwarup Srinivasan
06/29/2023, 10:10 PMAriel Kaspit
07/11/2023, 9:58 AMMaxParallelism
value in the Helm chart?
Thanks!Samhita Alla
Ariel Kaspit
07/12/2023, 7:34 AMSamhita Alla
flyte-admin-base-config
config map in your deployment?maxParallelism
to the flyteadmin
block, Ariel.
https://github.com/flyteorg/flyte/blob/951a93080972bbcf85bc92ec54ac62e074be887f/charts/flyte-core/values-eks.yaml#L16
flyteadmin:
maxParallelism: 25