has anyone else encountered something similar Is there a way

Question

has anyone else encountered something similar Is there a way to provision more shared memory to a specific task

Yee · Answer

cc < Eduardo Apolinario eapolinario > < jeev>

Yee · Answer

you re right we should probably address this along with gpus

Arthur Book · Answer

Thanks for the quick reply We added a `pod template name` that volumes it in A feature request could be to control this via the resource requests stuck out tongue

Yee · Answer

yeah we re seeing if there s anything common between migs and shm

jeev · Answer

+1

jeev · Answer

shm is basically set at as a <https kubernetes io docs concepts storage volumes emptydir|volume> memory backed `emptyDir` with an optional `sizeLimit` and a corresponding volume mount to the primary container i think the only thing it has in common with migs is that it requires an update to the pod spec sweat smile

Yee · Answer

well and maybe how it s specified by the user

jeev · Answer

in flytekit there might also validations we need to do where shm size limit has to be less than memory limit shm usage counts towards container memory usage and sizelimit is also optional uses up to container memory limit

Uria Franko · Answer

Hey < Yee> < jeev> < Arthur Book> Did you guys solve it in any easy way or any example for pod template for that I m encountering it when working with DataLoaders stuck out tongue

jeev · Answer

there is an example here <https github com unionai oss llm fine tuning blob 77c42f7b297aec8783720ce2dd14fe873cb55503 fine tuning llm fine tuning py L378|https github com unionai oss llm fine tuning blob 77c42f7b297aec8783720ce2dd14fe873cb55503 fine tuning llm fine tuning py L378>

Uria Franko · Answer

Thanks