Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,529

Full-text search

Active filters: llama-cpp

AlicanKiraz0/SenecaLLM-Q4_K_M-GGUF

Updated Mar 15 • 30 • 20

Guilherme34/01-v2-Q6_K-GGUF

Updated Dec 27, 2024 • 5 • 1

gghfez/32B-Qwen2.5-Kunou-v1-Q4_K_M-GGUF

Updated Dec 30, 2024 • 26 • 4

newsletter/deepseek-moe-16b-chat-Q8_0-GGUF

Updated Dec 30, 2024 • 51 • 1

SickDodger/Mistral-7B-Instruct-v0.3-abliterated-Q6_K-GGUF

Updated Jan 5 • 23 • 1

Smorty100/godot_dodo_4x_60k_llama_7b-Q4_K_M-GGUF

Updated Jan 5 • 55 • 1

AlicanKiraz0/QwQ-32B-Preview-SenecaLLMv1.2-Q4_K_M-GGUF

Text Classification • Updated Mar 15 • 11 • 4

AlicanKiraz0/QwQ-32B-Preview-SenecaLLMv1.2-Q8_0-GGUF

Text Classification • Updated Mar 15 • 9 • 3

yoeven/multilingual-e5-large-instruct-Q5_0-GGUF

Updated Jan 6 • 10 • 2

yoeven/multilingual-e5-large-instruct-Q5_K_M-GGUF

Updated Jan 6 • 17 • 1

yoeven/multilingual-e5-large-instruct-Q3_K_S-GGUF

Updated Jan 6 • 17 • 1

narainp/jina-embeddings-GGUF

Feature Extraction • Updated Jan 8 • 65 • 1

ngxson/MiniThinky-v2-1B-Llama-3.2-Q8_0-GGUF

Updated Jan 8 • 16 • 8

vtriple/Qwen-2.5-7B-Threatflux-Q4_K_M-GGUF

Updated Jan 9 • 7 • 1

mrcuddle/DarkHermes3-Llama3.2-3B-Instruct-Q5_K_M-GGUF

Updated Jan 10 • 1

magicunicorn/mxbai-embed-large-v1-Q8_0-GGUF

Feature Extraction • Updated Jan 12 • 20 • 1

mt1234/PATH-14B-COT-Q4_K_M-GGUF

Updated Jan 13 • 1

AlicanKiraz0/SenecaLLM_x_gemma-2-9b-CyberSecurity-Q4

Text Generation • Updated Mar 15 • 92 • 3

roleplaiapp/phi-4-Q3_K_S-GGUF

Text Generation • Updated Jan 14 • 7 • 1

nerdigent/Darkest-muse-v1-lorablated-v2-Q8_0-GGUF

Updated Jan 14 • 9 • 1

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • Updated Jan 15 • 134 • 2

mrcuddle/Qwen2.5-Coder-3B-Instruct-TS-Q5_K_M-GGUF

Updated Jan 15 • 14 • 1

nerdigent/Gemma-Radiation-RP-9B-lorablated-Q8_0-GGUF

Updated Jan 16 • 5 • 1

roleplaiapp/AceInstruct-7B-Q2_K-GGUF

Text Generation • Updated Jan 19 • 2 • 1

roleplaiapp/AceInstruct-1.5B-Q8_0-GGUF

Text Generation • Updated Jan 19 • 43 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_0-GGUF

Text Generation • Updated Jan 20 • 136 • 2

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q6_K-GGUF

Text Generation • Updated Jan 20 • 46 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q3_K_S-GGUF

Text Generation • Updated Jan 20 • 10 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q8_0-GGUF

Text Generation • Updated Jan 20 • 66 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated Jan 20 • 35 • 1