Is there a way to configure a timeout on a task level that doesn't include queue'd up time. e.g. if I'm only interested in timing out when a task in a map_task is running (not when its waiting for its turn in the concurrency pool).

Timeout should actually take into account the runtime only. Are you observing queue'd up time being considered as part of the timeout param value?