A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Thien Tran
gaunernst
AI & ML interests
None yet
Recent Activity
new activity
16 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Broken results with vLLM
new activity
20 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Cannot find the config file for awq
new activity
21 days ago
gaunernst/gemma-3-27b-it-int4-awq:Model running badly on vLLM
Organizations
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 27 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 928 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.53k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.17k • 10
A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 27 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 928 • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.53k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 2.17k • 10
models
55
gaunernst/vit_base_patch16_1024_128.audiomae_as2m
0.1B
•
Updated
•
65
•
1
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text
•
6B
•
Updated
•
2.17k
•
10
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text
•
6B
•
Updated
•
1.61k
•
9
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text
•
3B
•
Updated
•
1.2k
•
1
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text
•
2B
•
Updated
•
2.16k
•
2
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation
•
0.4B
•
Updated
•
234
gaunernst/DeepSeek-V2-Lite-Chat-FP8
16B
•
Updated
•
848
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text
•
3B
•
Updated
•
1.53k
•
6
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text
•
2B
•
Updated
•
928
•
1
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
0.4B
•
Updated
•
27
datasets
11
gaunernst/ms1mv3-recordio
Updated
•
21
•
1
gaunernst/flux-dev-portrait
Viewer
•
Updated
•
2k
•
151
•
1
gaunernst/pexels-portrait
Viewer
•
Updated
•
9.85k
•
16
•
1
gaunernst/ffhq-1024-wds
Viewer
•
Updated
•
70.3k
•
111
gaunernst/face-recognition-eval
Updated
•
3
gaunernst/voxceleb2-dev-wds
Viewer
•
Updated
•
1.09M
•
47
gaunernst/glint360k-wds-gz
Viewer
•
Updated
•
17.1M
•
212
•
3
gaunernst/webface4m-wds-gz
Viewer
•
Updated
•
4.24M
•
226
•
3
gaunernst/ms1mv3-wds-gz
Viewer
•
Updated
•
5.18M
•
52
•
2
gaunernst/tokenized-datasets
Updated
•
6