https://flyte.org logo
#ask-the-community
Title
# ask-the-community
a

Arthur Book

07/06/2023, 9:57 PM
has anyone else encountered something similar? Is there a way to provision more shared memory to a specific task?
y

Yee

07/06/2023, 10:47 PM
cc @Eduardo Apolinario (eapolinario) @jeev
you’re right we should probably address this along with gpus
a

Arthur Book

07/06/2023, 10:51 PM
Thanks for the quick reply. We added a
pod_template_name
that volumes it in. A feature request could be to control this via the resource requests 😛
y

Yee

07/06/2023, 10:54 PM
yeah we’re seeing if there’s anything common between migs and shm
j

jeev

07/06/2023, 11:09 PM
👍
shm is basically set at as a volume (memory-backed
emptyDir
with an optional
sizeLimit
) and a corresponding volume mount to the primary container. i think the only thing it has in common with migs is that it requires an update to the pod spec. 😅
y

Yee

07/06/2023, 11:26 PM
well, and maybe how it’s specified by the user.
j

jeev

07/07/2023, 12:53 PM
in flytekit? there might also validations we need to do where shm size limit has to be less than memory limit - shm usage counts towards container memory usage. and sizelimit is also optional - uses up to container memory limit.
u

Uria Franko

09/21/2023, 3:05 PM
Hey @Yee @jeev @Arthur Book Did you guys solve it in any easy way or any example for pod_template for that? I’m encountering it when working with DataLoaders 😛
u

Uria Franko

09/21/2023, 4:19 PM
Thanks!
12 Views