Hugging Face's logo
Nathan Habib's picture
159 42 61

Nathan Habib

SaylorTwift
imstevenpmwork's profile picture derekl35's profile picture Fonk's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted an article 27 days ago
Reachy Mini - The Open-Source Robot for Today's and Tomorrow's AI Builders
liked a model 27 days ago
HuggingFaceTB/SmolLM3-3B
reacted to nicolay-r's post with 🔥 27 days ago
🚀 For those who interested in summarization of the long textual reports in medical domain 📝🩺, @Xiaolihai and I delighted to share that we experiment with distillation tuning adaptation for Qwen-2.5 0.5B. We use reports from the MultiClinSum dataset and pass it through 72B version to retrieve report explanations in order to initiate ditillation tuning for 0.5B model. We experiment with passages written in English, French, Portuguese, and Spanish. 🔑 We find that using distil-technique results in 2-4% performance increment on fine-tuning and similar improvements for reports in English (non-official and official evaluation). For the other it results in systems that perform similar to the convential tuning (standard) (see result below). Dataset: https://zenodo.org/records/15459174 Competition: https://participants-area.bioasq.org/general_information/MultiClinSum/ Github: https://github.com/nicolay-r/distil-tuning-llm model: https://huggingface.co/nicolay-r/qwen25-05b-multiclinsum-distil
View all activity

Organizations

Hugging Face's profile picture Evaluation datasets's profile picture Hugging Test Lab's profile picture HuggingFaceGECLM's profile picture BigCode's profile picture Hugging Face H4's profile picture BigCode Data's profile picture Hugging Face Smol Models Research's profile picture Hugging Face Smol Cluster's profile picture Open LLM Leaderboard's profile picture huggingPartyParis's profile picture Qwen's profile picture gg-hf's profile picture Nanotron Research's profile picture FineData's profile picture HF-contamination-detection's profile picture Top Contributors: Dataset Downloads's profile picture hsramall's profile picture La Leaderboard's profile picture gg-tt's profile picture HuggingFaceEval's profile picture Novel Challenge's profile picture LLHF's profile picture SLLHF's profile picture lbhf's profile picture Lighteval testing org's profile picture Hugging Face Science's profile picture Coordination Nationale pour l'IA's profile picture open-llm-leaderboard-react's profile picture Prompt Leaderboard's profile picture wut?'s profile picture Your Bench's profile picture Open R1's profile picture gg-hf-g's profile picture OpenEvals's profile picture arc-agi-community's profile picture yofo's profile picture LightEval Internal Testing's profile picture