Vijayakumar Ramdoss's picture

5 5

Vijayakumar Ramdoss

nellaivijay

·

nellaivijay

AI & ML interests

None yet

Recent Activity

liked a model about 2 months ago

demo-leaderboard/gpt2-demo

upvoted a collection 4 months ago

Qwen Scheduler GRPO

reacted to anakin87's post with 👍 4 months ago

𝗜 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝗮 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝘁𝗼 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗲𝘃𝗲𝗻𝘁𝘀 𝘄𝗶𝘁𝗵 𝗚𝗥𝗣𝗢! 👑 🗓️ ✍️ Blog post: https://huggingface.co/blog/anakin87/qwen-scheduler-grpo I experimented with GRPO lately. I am fascinated by models learning from prompts and rewards - no example answers needed like in Supervised Fine-Tuning. After the DeepSeek boom, everyone is trying GRPO with GSM8K or the Countdown Game... I wanted a different challenge, like 𝘁𝗲𝗮𝗰𝗵𝗶𝗻𝗴 𝗮 𝗺𝗼𝗱𝗲𝗹 𝘁𝗼 𝗰𝗿𝗲𝗮𝘁𝗲 𝗮 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗳𝗿𝗼𝗺 𝗮 𝗹𝗶𝘀𝘁 𝗼𝗳 𝗲𝘃𝗲𝗻𝘁𝘀 𝗮𝗻𝗱 𝗽𝗿𝗶𝗼𝗿𝗶𝘁𝗶𝗲𝘀. Choosing an original problem forced me to: 🤔 Think about the problem setting 🧬 Generate data 🤏 Choose the right base model 🏆 Design reward functions (and experiencing reward hacking) 🔄 Run multiple rounds of training, hoping that my model would learn something. A fun and rewarding 😄 experience. I learned a lot of things, that I want to share with you. 👇 ✍️ Blog post: https://huggingface.co/blog/anakin87/qwen-scheduler-grpo 💻 Code: https://github.com/anakin87/qwen-scheduler-grpo 🤗 Hugging Face collection (dataset and model): https://huggingface.co/collections/anakin87/qwen-scheduler-grpo-680bcc583e817390525a8837

View all activity

Organizations

None yet

upvoted a collection 4 months ago

Qwen Scheduler GRPO

Train a SLM to create a schedule from a list of events and priorities - Article: https://t.ly/-Dejx - Code: https://t.ly/1J_VG • 2 items • Updated Apr 29 • 4

upvoted an article 4 months ago

Article

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

By

and 8 others •

Apr 29

• 39

upvoted a collection 4 months ago

Llama 4

Llama 4 release • 13 items • Updated Apr 29 • 604

upvoted 2 papers 4 months ago

DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning

Paper • 2504.11456 • Published Apr 15 • 13

Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems

Paper • 2504.01990 • Published Mar 31 • 300