Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29

Base only

Active filters: iq4_xs

Skttttt/Himeros_27B_IQ4XS

Text Generation • 27B • Updated 3 days ago • 224 • 2

impacte/NVIDIA-Nemotron-3.5-Lightning-GGUF

Text Generation • 33B • Updated 3 days ago • 147 • 2

Lucebox/Qwen3.8-27B-IQ4_XS-fast-GGUF

27B • Updated 3 days ago • 251 • 2

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated 12 days ago • 4.02k • 7

Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF

Text Generation • 27B • Updated 9 days ago • 1.81k • 1

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 23

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 78

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 55 • 5

kaushall13/Qwen3.5-9B-GGUF-SBGQ

Text Generation • 9B • Updated Mar 26 • 27

ospost/gpt-oss-20b-sft-GGUF

21B • Updated Apr 1 • 18

dxx117/MiniMax-M2.7-IQ4_XS-HQ-GGUF

Text Generation • 229B • Updated Apr 14 • 5

end000/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 19 • 42 • 1

Krasnopjorovs/Qwen3.6-35B-A3B-IQ4_XS-Imatrix

Text Generation • 35B • Updated Apr 22 • 51 • 1

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 7

localweights/Qwen3.6-27B-MTP-IQ4_XS-GGUF

27B • Updated May 7 • 176 • 5

localweights/Qwen3.6-35B-A3B-MTP-IQ4_XS-GGUF

36B • Updated May 7 • 504 • 4

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

27B • Updated May 23 • 74 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 78 • 1

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated Jun 17 • 93

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 413 • 1

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 561 • 6

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 135 • 2

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 812 • 4

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 574 • 1

pearsonkyle/Ornith-1.0-9B-imatrix-GGUF

Text Generation • 9B • Updated Jul 11 • 523 • 2

xero0000/Gemma-4-26B-A4B-it-vram14-iq4xs-imat

Text Generation • 25B • Updated Jul 19 • 157 • 1

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated Jul 22 • 578 • 13

Verkiki/Qwen3.8-27b-Fable5-Distill-Abliterated-GGUF

Text Generation • 0.5B • Updated 8 days ago • 3.01k • 2

Hob-forge/Qwen3.5-4B-Instruct-GGUF

Text Generation • 4B • Updated 5 days ago • 400