Alex Pozimenko
08/05/2022, 5:30 PMKetan (kumare3)
Alex Pozimenko
08/05/2022, 5:56 PMKetan (kumare3)
Alex Pozimenko
08/05/2022, 7:01 PMKetan (kumare3)
Alex Pozimenko
08/05/2022, 7:26 PMmax_parallelism (Optional[int]) – Controls the maximum number of tasknodes that can be run in parallel for the entire workflow. This is useful to achieve fairness. Note: MapTasks are regarded as one unit, and parallelism/concurrency of MapTasks is independent from this.
do I read this right that it doesn't apply to maptasks? What about spark?Ketan (kumare3)
Alex Pozimenko
08/05/2022, 8:40 PM