Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

36,159

Full-text search

Active filters: 4-bit

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

12B • Updated about 7 hours ago • 14

sid22669/MCQ_Generator

Text Generation • 4B • Updated 5 days ago • 421 • 4

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • 13B • Updated Mar 7 • 22.8k • 57

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 3B • Updated Apr 6 • 342k • 77

adamo1139/DeepSeek-R1-0528-AWQ

Text Generation • Updated 23 days ago • 164 • 3

unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit

Image-Text-to-Text • 13B • Updated 4 days ago • 1.34k • 3

unsloth/Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit

Image-Text-to-Text • 13B • Updated 4 days ago • 3.09k • 3

unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit

Image-Text-to-Text • 8B • Updated 1 day ago • 315 • 3

unsloth/gemma-3n-E4B-unsloth-bnb-4bit

Image-Text-to-Text • 8B • Updated 1 day ago • 20 • 3

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Sep 29, 2023 • 7.69k • 83

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 223k • 102

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 5B • Updated Feb 15 • 389k • 75

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • 2B • Updated 25 days ago • 14k • 17

NetoAISolutions/TSLAM-4B

2B • Updated Apr 25 • 4 • 13

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • 5B • Updated May 12 • 46.4k • 11

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 10.4k • 18

unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit

Text Generation • 5B • Updated 18 days ago • 30.5k • 6

Qwen/Qwen3-235B-A22B-MLX-4bit

Text Generation • 33B • Updated 1 day ago • 297 • 9

cnfusion/Kimi-Dev-72B-mlx-4Bit

Text Generation • 11B • Updated 11 days ago • 381 • 4

vlbosch/Qwen3-235B-A22B-MLX-mixed-4bit

235B • Updated 7 days ago • 236 • 2

mlx-community/Mistral-Small-3.2-24B-Instruct-2506-4bit

Text Generation • 24B • Updated 6 days ago • 581 • 2

unsloth/gemma-3n-E2B-unsloth-bnb-4bit

Image-Text-to-Text • 5B • Updated 1 day ago • 17 • 2

TheBloke/storytime-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 1.83k • 39

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • 5B • Updated Nov 13, 2023 • 2.46k • 39

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • 1B • Updated Nov 20, 2023 • 35 • 2

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-GPTQ

Text Generation • 1B • Updated Nov 20, 2023 • 17 • 3

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • 0.8B • Updated Dec 13, 2023 • 2.5k • 36

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Dec 11, 2023 • 50.6k • 52

PrunaAI/Mistral-7B-Instruct-v0.2-bnb-4bit

4B • Updated Aug 2, 2024 • 10 • 3

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • 141B • Updated Apr 16, 2024 • 1.38k • 129