Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,224

Full-text search

Active filters: quantized

RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • Updated about 1 hour ago • 697 • 7

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated 24 days ago • 4.72k • 21

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated less than a minute ago • 9.42k • 12

jedisct1/MiMo-7B-RL-GGUF

Updated 13 days ago • 20.9k • 16

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • Updated about 1 hour ago • 121 • 3

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 14 days ago • 124k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 14 days ago • 122k • 3

NextGenC/erynn-1-774m

Text Generation • Updated 14 days ago • 12 • 2

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • Updated Nov 6, 2023 • 53 • 2

afrideva/TinyMistral-248M-GGUF

Text Generation • Updated Dec 11, 2023 • 10.6k • 5

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 94 • 4

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 150 • 10

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 354k • 7

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.14k • 11

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 89 • 3

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 108 • 3

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 17 • 10

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 24

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 3.72k • 39

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 21 days ago • 362k • 130

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Dec 18, 2024 • 65

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 492 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 189 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.14k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 309k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.59k • 127

Lewdiculous/Aura_v2_7B-GGUF-IQ-Imatrix

Updated Apr 16, 2024 • 236 • 13

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.3k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 328k • 89

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • Updated May 12, 2024 • 64 • 2