MiniPLM Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models MiniLLM/MiniPLM-Qwen-200M Text Generation • 0.2B • Updated Oct 27, 2024 • 194 • 9 MiniLLM/MiniPLM-Qwen-500M Text Generation • 0.5B • Updated Mar 25 • 19 • 7 MiniLLM/MiniPLM-Qwen-1.2B Text Generation • 1B • Updated Mar 25 • 16 • 4 MiniLLM/MiniPLM-Mamba-130M Text Generation • 0.1B • Updated Mar 25 • 48 • 3
MiniLLM MiniLLM Models MiniLLM/MiniLLM-gpt2-120M Text Generation • 0.1B • Updated Sep 26, 2024 • 798 MiniLLM/MiniLLM-gpt2-340M Text Generation • Updated Apr 11 • 851 • 4 MiniLLM/MiniLLM-gpt2-760M Text Generation • Updated Sep 26, 2024 • 105 MiniLLM/MiniLLM-OPT-1.3B Text Generation • Updated Sep 26, 2024 • 11 • 1
MiniPLM Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models MiniLLM/MiniPLM-Qwen-200M Text Generation • 0.2B • Updated Oct 27, 2024 • 194 • 9 MiniLLM/MiniPLM-Qwen-500M Text Generation • 0.5B • Updated Mar 25 • 19 • 7 MiniLLM/MiniPLM-Qwen-1.2B Text Generation • 1B • Updated Mar 25 • 16 • 4 MiniLLM/MiniPLM-Mamba-130M Text Generation • 0.1B • Updated Mar 25 • 48 • 3
MiniLLM MiniLLM Models MiniLLM/MiniLLM-gpt2-120M Text Generation • 0.1B • Updated Sep 26, 2024 • 798 MiniLLM/MiniLLM-gpt2-340M Text Generation • Updated Apr 11 • 851 • 4 MiniLLM/MiniLLM-gpt2-760M Text Generation • Updated Sep 26, 2024 • 105 MiniLLM/MiniLLM-OPT-1.3B Text Generation • Updated Sep 26, 2024 • 11 • 1
