https://flyte.org logo
#ask-the-community
Title
# ask-the-community
v

Visak

03/22/2023, 5:11 PM
When using map_task with a large number of inputs I get the following error
array size > max allowed. requested [13947]. allowed [5000].
How can I address this? Is there a way I can increase this size or is there a workaround to the size limit? Appreciate any help!
b

Bernhard Stadlbauer

03/22/2023, 5:29 PM
Hi Visak! That’s possible! You’d need to set the
maxArrayJobSize
size in the k8s-array config. The full config path should be
k8s.plugins.k8-array.maxArrayJobSize
v

Visak

03/22/2023, 6:24 PM
Thank you! this is great
k

Ketan (kumare3)

03/22/2023, 11:56 PM
I recommend not to go too high