Models

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix

Text Generation • Updated 4 days ago • 156 • 3

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Oct 18, 2024 • 20.5k • 26

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • 3B • Updated May 19 • 1.77k • 50

QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8

Text Generation • 8B • Updated 5 days ago • 670 • 2

tencent/Hunyuan-7B-Instruct-GPTQ-Int4

Text Generation • 1B • Updated about 11 hours ago • 2 • 2

TheBloke/WizardLM-13B-V1.0-Uncensored-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 999 • 30

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 5.7k • 211

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation • 0.7B • Updated Oct 9, 2024 • 1.5k • 3

hfl/Qwen2.5-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • 3B • Updated Mar 20 • 1.4k • 4

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • 3B • Updated Apr 30 • 4.6k • 2

btbtyler09/Qwen3-30B-A3B-gptq-8bit

Text Generation • 9B • Updated May 2 • 819 • 3

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 31.5k • 20

Qwen/Qwen3-0.6B-GPTQ-Int8

Text Generation • 0.3B • Updated May 21 • 3.02k • 8

iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit

Text Generation • 1B • Updated May 20 • 115k • 1

Intel/DeepSeek-R1-0528-int4-AutoRound

Updated 8 days ago • 32 • 1

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 11B • Updated 25 days ago • 161k • 48

LGAI-EXAONE/EXAONE-4.0-1.2B-GPTQ-Int8

Text Generation • 0.5B • Updated 4 days ago • 157 • 8

QuantTrio/GLM-4.1V-9B-Thinking-GPTQ-Int4-Int8Mix

Text Generation • 3B • Updated 12 days ago • 6 • 1

groxaxo/OpenCodeReasoning-Nemotron-1.1-32B-GPTQ-W8A16

Text Generation • Updated 7 days ago • 1

btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit

Text Generation • 5B • Updated 4 days ago • 806 • 1

jart25/Qwen3-30B-A3B-Instruct-2507-Autoround-Int-8bit-gptq

0.6B • Updated about 13 hours ago • 7 • 1

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 9 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 10 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 50 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 17 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 10 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 10 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 13 • 45

TheBloke/koala-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 39 • 31

TheBloke/koala-7B-HF

Text Generation • Updated Jun 5, 2023 • 2k • 21