A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Thien Tran
gaunernst
AI & ML interests
None yet
Recent Activity
new activity
12 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Broken results with vLLM
new activity
17 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Cannot find the config file for awq
new activity
17 days ago
gaunernst/gemma-3-27b-it-int4-awq:Model running badly on vLLM
Organizations
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 27 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 923 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.57k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.35k • 10
A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 27 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 923 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.57k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.35k • 10
models
55
gaunernst/vit_base_patch16_1024_128.audiomae_as2m
0.1B
•
Updated
•
112
•
1
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text
•
6B
•
Updated
•
2.35k
•
10
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text
•
6B
•
Updated
•
1.68k
•
9
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text
•
3B
•
Updated
•
1.2k
•
1
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text
•
2B
•
Updated
•
1.91k
•
2
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation
•
0.4B
•
Updated
•
324
gaunernst/DeepSeek-V2-Lite-Chat-FP8
16B
•
Updated
•
884
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text
•
3B
•
Updated
•
1.57k
•
6
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text
•
2B
•
Updated
•
923
•
1
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
0.4B
•
Updated
•
27
datasets
11
gaunernst/ms1mv3-recordio
Updated
•
26
•
1
gaunernst/flux-dev-portrait
Viewer
•
Updated
•
2k
•
203
•
1
gaunernst/pexels-portrait
Viewer
•
Updated
•
9.85k
•
17
•
1
gaunernst/ffhq-1024-wds
Viewer
•
Updated
•
70.3k
•
154
gaunernst/face-recognition-eval
Updated
•
2
gaunernst/voxceleb2-dev-wds
Viewer
•
Updated
•
1.09M
•
38
gaunernst/glint360k-wds-gz
Viewer
•
Updated
•
17.1M
•
167
•
2
gaunernst/webface4m-wds-gz
Viewer
•
Updated
•
4.24M
•
211
•
3
gaunernst/ms1mv3-wds-gz
Viewer
•
Updated
•
5.18M
•
28
•
2
gaunernst/tokenized-datasets
Updated
•
7