Models

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 35.9k • 35

tencent/Hunyuan-7B-Instruct-GPTQ-Int4

Text Generation • 1B • Updated 3 days ago • 98 • 4

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 29.1k • 22

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • 3B • Updated Apr 30 • 1.63k • 3

btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit

Text Generation • 5B • Updated 8 days ago • 1.08k • 3

TheBloke/WizardLM-13B-V1.0-Uncensored-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 1.02k • 30

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 5.68k • 212

Qwen/Qwen-7B-Chat-Int4

Text Generation • 2B • Updated Jan 4, 2024 • 1.86k • 75

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation • 0.7B • Updated Oct 9, 2024 • 1.71k • 3

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Oct 18, 2024 • 20.1k • 26

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • 3B • Updated May 19 • 1.3k • 50

Qwen/Qwen3-1.7B-GPTQ-Int8

Text Generation • 0.7B • Updated May 21 • 1.93k • 3

Qwen/Qwen3-0.6B-GPTQ-Int8

Text Generation • 0.3B • Updated May 21 • 3.17k • 8

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 12.9k • 21

iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit

Text Generation • 1B • Updated May 20 • 115k • 1

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10 • 324 • 1

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 11B • Updated 29 days ago • 168k • 48

QuantTrio/GLM-4.1V-9B-Thinking-GPTQ-Int4-Int8Mix

Text Generation • 3B • Updated 16 days ago • 32 • 1

QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8

Text Generation • 8B • Updated 10 days ago • 1.74k • 2

jart25/Qwen3-30B-A3B-Instruct-2507-Autoround-Int-8bit-gptq

0.6B • Updated 5 days ago • 9 • 1

jart25/Qwen3-30B-A3B-Thinking-2507-Autoround-Int-4bit-gptq

0.6B • Updated 8 days ago • 19 • 1

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated 8 days ago • 625 • 1

Dinith132/first_lora

Updated 1 day ago • 1

TheBloke/Loyal-Macaroni-Maid-7B-GPTQ

Text Generation • 1B • Updated Dec 24, 2023 • 82 • 13

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 16 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 17 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 60 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 23 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 17 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 17 • 2