Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,519

Full-text search

Active filters: 6-bit

mlx-community/Dia-1.6B-6bit

Text-to-Speech • Updated 19 days ago • 669 • 8

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 15 days ago • 124k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 14 days ago • 122k • 3

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 108 • 3

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 492 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 189 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.14k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 309k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.59k • 127

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.3k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 328k • 89

hjhj3168/Llama-3-8b-Orthogonalized-exl2

Text Generation • Updated May 1, 2024 • 13 • 91

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 339k • 96

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 314k • 44

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 300k • 19

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26, 2024 • 18.4k • 21

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 333k • 12

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 303k • 9

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated Sep 9, 2024 • 11 • 3

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 244k • 12

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 308k • 11

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 79 • 26

MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUF

Text Generation • Updated Oct 20, 2024 • 145 • 2

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • Updated Oct 31, 2024 • 28 • 1

MaziyarPanahi/llm_3_2_flux_prompt-GGUF

Text Generation • Updated Nov 2, 2024 • 75 • 3

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 101 • 3

FluffyKaeloky/L3.3-70B-Euryale-v2.3-exl2-6.0bpw

Text Generation • Updated Dec 11, 2024 • 11 • 1

MaziyarPanahi/Captain-Eris_Violet-V0.420-12B-GGUF

Text Generation • Updated Dec 16, 2024 • 64 • 1

mlx-community/phi-4-6bit

Text Generation • Updated Jan 12 • 79 • 6

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • Updated Dec 23, 2024 • 100 • 1