Models

ByteDance-Seed/Seed-X-PPO-7B-GPTQ-Int8

Translation • 8B • Updated 11 days ago • 1.11k • 5

cpatonn/GLM-4.5-Air-GPTQ-4bit

Text Generation • 18B • Updated 7 days ago • 747 • 3

ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W8A8

Text Generation • 31B • Updated 6 days ago • 183 • 1

cpatonn/Qwen3-30B-A3B-Instruct-2507-AWQ-4bit

Text Generation • 5B • Updated 9 days ago • 3.53k • 6

tencent/Hunyuan-4B-Instruct-FP8

Text Generation • 4B • Updated 2 days ago • 29 • 1

cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit

Text Generation • 5B • Updated 8 days ago • 4.83k • 6

unsloth/cogito-v2-preview-deepseek-671B-MoE-FP8

Text Generation • 671B • Updated 8 days ago • 7 • 1

ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W8A8

Text Generation • 31B • Updated 5 days ago • 165 • 1

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated 6 days ago • 385 • 2

cpatonn/Qwen3-Coder-30B-A3B-Instruct-GPTQ-8bit

Text Generation • 8B • Updated 6 days ago • 395 • 2

RedHatAI/gemma-3n-E2B-it-quantized.w8a8

Image-Text-to-Text • 5B • Updated 7 days ago • 18 • 1

2imi9/Qwen3-1.7B-NVFP4A16

Text Generation • 1B • Updated 3 days ago • 18 • 1

warshanks/Huihui-Qwen3-14B-abliterated-v2-AWQ

Text Generation • 3B • Updated 3 days ago • 27 • 1

cpatonn/Light-IF-32B-AWQ

Text Generation • 6B • Updated 3 days ago • 24 • 1

warshanks/Qwen3-4B-Thinking-2507-AWQ

Text Generation • 1B • Updated 2 days ago • 39 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 5

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 4

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • 0.3B • Updated Oct 10, 2024 • 2

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 2

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 3

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • 1B • Updated Oct 9, 2024 • 2

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 3

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • 8B • Updated Oct 9, 2024 • 8

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • 0.9B • Updated Jun 4, 2024 • 4

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • 1B • Updated Jun 4, 2024 • 4

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • 0.8B • Updated Oct 9, 2024 • 2

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • 1B • Updated Oct 9, 2024 • 6.84k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • 1B • Updated Oct 9, 2024 • 4

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt

Text Generation • 0.9B • Updated Oct 9, 2024 • 4

nm-testing/tinyllama-marlin24-w4a16-group128

Text Generation • 0.3B • Updated Oct 9, 2024 • 5