https://flyte.org logo
#ask-the-community
Title
# ask-the-community
g

Guy Arad

11/26/2023, 10:10 AM
I'm trying to understand the timing of the tasks. I'm using Sandbox only because I couldn't deploy it properly on AWS. For example, when using a
map_task
the UI shows simple execution of 1 task with access to the individual tasks. Which is great. I checked the logs of each task, after adding a print at the beginning of the execution, and it looks like they weren't running in parallel. The sandbox seem to have enough resources to run multiple pods.
s

Samhita Alla

11/27/2023, 7:07 AM
have you set concurrency in the map task by any chance?
g

Guy Arad

11/27/2023, 7:11 AM
No, should I?
s

Samhita Alla

11/27/2023, 7:16 AM
nope, not necessary. could you elaborate on why you think the tasks aren't running in parallel despite having enough resources?
g

Guy Arad

11/27/2023, 11:52 AM
honestly, it's a little hard to tell. I checked when the tasks started running. I'm using Flyte sandbox. By the K8s dashboard, it seems we still have some cores and memory to accommodate more than one task in parallel.
s

Samhita Alla

11/27/2023, 4:15 PM
okay. can you try increasing the allotted memory to verify if more map tasks are being scheduled?
3 Views