@ancient-wolf-19325 how do i arbitrarily limit concurrency within a dynamic task?

To limit concurrency within a dynamic task in Flyte, you can use the

concurrency

parameter available in the

map_task

function. This parameter allows you to specify the maximum number of tasks that can run in parallel. If the input size exceeds the concurrency value, tasks will be executed in batches until all inputs are processed. If set to 0, it means unbounded concurrency. If left unspecified, the array node will inherit parallelism from the workflow. Would you like more detail on how to implement this? Sources: - flytekit.map_task - flytekit/core/array_node.py 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.