Technical support for the SmallDoges series models.
AI & ML interests
A Family of Dynamic UltraFast Small Language Models Ready for Embodied Artificial General Intelligence!
Recent Activity
View all activity
Organization Card

SmallDoge
Welcome to SmallDoge, where we pioneer the development of compact, high-performance small language models. Our focus is on creating ultra-fast SLMs using innovative dynamic algorithms. Committed to transparency and collaboration, all our training details and code are openly accessible on the SmallDoge GitHub repository.
Our Mission: To democratize access to advanced AI by developing efficient, open-source small language models that empower a wide range of applications and research.
Join our community on Discord!
Explore Our Projects
We offer a suite of resources and models:
- Small-Doges: A versatile series of SLMs, including pre-trained base models, supervised fine-tuned models, and models enhanced with reinforcement learning.
- Doge-CheckPoints: A collection of model checkpoints designed for seamless continued training on new datasets, ensuring smoother adaptation and minimizing training instability.
- Small-Datasets: Curated, multi-stage, high-quality datasets specifically engineered to effectively train small language models, boosting their capabilities and helpfulness.
- Doge-Downstream-Applications: A selection of SLMs optimized for various downstream tasks and real-world applications.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 107 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 305 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 6 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 0.1B • Updated • 166 • 6
Technical support for the SmallDoges series models.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 107 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 305 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 6 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 0.1B • Updated • 166 • 6
models
102

SmallDoge/Doge-40M-MoE-checkpoint
Text Generation
•
0.0B
•
Updated
•
55

SmallDoge/Doge-40M-checkpoint
Text Generation
•
0.0B
•
Updated

SmallDoge/Doge-40M-MoE
Text Generation
•
0.0B
•
Updated
•
17

SmallDoge/Doge-40M
Text Generation
•
0.0B
•
Updated

SmallDoge/Doge-tokenizer
Updated
•
1

SmallDoge/Doge-320M-Instruct-SFT
Question Answering
•
0.3B
•
Updated
•
33
•
1

SmallDoge/Doge-160M-Instruct
Question Answering
•
0.2B
•
Updated
•
305
•
12

SmallDoge/Doge-160M-Instruct-SFT
Question Answering
•
0.2B
•
Updated
•
13

SmallDoge/Doge-160M
Text Generation
•
0.2B
•
Updated
•
23
•
6

SmallDoge/Doge-60M-Instruct-SFT
Question Answering
•
0.1B
•
Updated
•
10
datasets
41
SmallDoge/reasoning-zh-try-run
Viewer
•
Updated
•
54
•
41
SmallDoge/SmallCorpus
Viewer
•
Updated
•
190M
•
1.78k
•
7
SmallDoge/Doge
Viewer
•
Updated
•
16M
•
323
SmallDoge/Qwen3-Short-Reasoning
Viewer
•
Updated
•
24.9k
•
94
SmallDoge/Qwen3-Long-Reasoning
Viewer
•
Updated
•
24.9k
•
92
SmallDoge/Thoughts-Long-25k-try-run
Viewer
•
Updated
•
2
•
96
SmallDoge/SmallThoughts
Viewer
•
Updated
•
102k
•
397
•
46
SmallDoge/stack-edu
Viewer
•
Updated
•
26M
•
545
SmallDoge/CDMoE_dataset
Viewer
•
Updated
•
40M
•
843
SmallDoge/MoE_dataset
Viewer
•
Updated
•
40M
•
476