Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,224

Full-text search

Active filters: quantized

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 7.18k • 4

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 281k • 3

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated Feb 2 • 61 • 2

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • Updated Feb 10 • 90 • 1

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10 • 21 • 2

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • Updated Feb 14 • 16 • 1

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated Feb 16 • 64 • 2

MaziyarPanahi/Ayla-Light-12B-Stock-GGUF

Text Generation • Updated Feb 18 • 65 • 1

sgedela/opt-125m-quantized

Text Generation • Updated Feb 22 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • Updated Feb 24 • 310 • 1

qualcomm/YOLOv11-Detection-Quantized

Object Detection • Updated Apr 9 • 1

piotrmaciejbednarski/PLLuM-8x7B-chat-GGUF

Text Generation • Updated Mar 3 • 205 • 1

mradermacher/TopicalStorm-Llama3.2-3b-GGUF

Updated Mar 1 • 25 • 1

mradermacher/TopicalStorm-Llama3.2-3b-i1-GGUF

Updated Mar 1 • 52 • 1

RedHatAI/phi-4-quantized.w8a8

Text Generation • Updated 27 days ago • 295 • 1

RedHatAI/phi-4-quantized.w4a16

Text Generation • Updated 20 days ago • 1.15k • 1

GainEnergy/ogai-8x7b-4bit

Text Generation • Updated Mar 5 • 1

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 268k • 3

MaziyarPanahi/Glowing-Forest-12B-GGUF

Text Generation • Updated Mar 8 • 25 • 1

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated Mar 12 • 291k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 277k • 6

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 272k • 4

MaziyarPanahi/MN-Hekate-Enodia-12B-GGUF

Text Generation • Updated Mar 23 • 79 • 1

MaziyarPanahi/Dirty-Shirley-Writer-v01-Uncensored-GGUF

Text Generation • Updated Mar 24 • 248 • 1

MaziyarPanahi/Dirty-Shirley-Writer-v0-abliterated-GGUF

Text Generation • Updated Mar 24 • 217 • 1

MaziyarPanahi/Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o-GGUF

Text Generation • Updated Mar 24 • 239 • 1

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • Updated Mar 24 • 124 • 1

mradermacher/TopicalStorm-Llama3.1-8b-GGUF

Updated Mar 26 • 62 • 2

mradermacher/TopicalStorm-Llama3.1-8b-i1-GGUF

Updated Mar 30 • 669 • 1

boltuix/bert-lite

Text Classification • Updated Apr 7 • 30 • 3