we are thinking of using flyte with sagemker hyperpod with EKS. I saw that there is a plugin for sagemaker which can be installed using helm. Anyone has tried that and if someone can pls share their experience

Hmm the old plugin has been deprecated - we have a serving plugin - and are collaborating with a few companies for a sagemaker training connector / agent Would love to understand the usecase

so currently we use sagemaker with slurm which is very painful for us to manage as we grew. i am trying to move to eks with sagemaker with flyte to send our jobs to sagemaker this is the lay of the land

Yup that is what will happen and the agent is pretty easy to develop actually

i will look into it but TBH slurm scheduler is not great and doesn’t manage the resources very well

We just found folks like it because researchers are used to it - and very large scale companies like it’s inter team (fair scheduling)