<@U064WSJQ9Q8> Can i get your grpo ppt slides plea...
# ml-and-mlops-questions
e
@powerful-horse-58724 Can i get your grpo ppt slides please. Also if you can share the dataset to fine-tune your 1.5B model. Thanks.
p
Here is one for coding if you can run a larger model, remember that the model needs to be able to do that task for it to learn with RL. YOu could also try different coding problems: github.com/unionai/workshops/…/llm-fine-tuning-grpo-code
I need to clean up this example and and merge it in, but but its a distributed one if you have multiple GPUs to do rollouts on: github.com/unionai/workshops/…/llm-fine-tuning-grpo-distributed
e
Thank you. 🤍
p
No problem! Are you training anything fun?
e
Thanks. I am trying your example on a Qwen2.5 3B.. trying all hyperparameters too. Goal is to learn/fine-tune any 3-7B model for wordle_v3. :)
p
That sounds like a fun project! Let's us know how it goes in this channel!
👍 1
e
Initially I used your code to fine-tune the Qwen2.5-3B model. Came out better. huggingface.co/…/d_qwen_finetuned_mathexp_full