Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
Backyard AI
Jan
Jellybox
llama.cpp
LM Studio
LocalAI
Msty
node-llama-cpp
Ollama
RecurseChat
Sanctum
TGI
vLLM
Apps with no match
Draw Things
DiffusionBee
Invoke
JoyFusion
MLX LM
Inference Providers
Inference Providers with no match
Novita
Fireworks
Nebius AI
Together AI
Cerebras
Featherless AI
Hyperbolic
Nscale
SambaNova
fal
Groq
Replicate
Cohere
HF Inference API
Misc
Reset Misc
llama.cpp
Inference Endpoints
4-bit precision
text-generation-inference
Merge
Eval Results
Misc with no match
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
196
Full-text search
Edit filters
Sort: Trending
Active filters:
llama.cpp
Clear all
MrOvkill/gemma-2-inference-endpoint-GGUF
Text Generation
•
Updated
Mar 11, 2024
•
6
google/gemma-1.1-7b-it-GGUF
9B
•
Updated
Jun 27, 2024
•
8
•
20
google/gemma-1.1-2b-it-GGUF
3B
•
Updated
Jun 27, 2024
•
11
•
20
webbigdata/C3TR-Adapter_gguf
Translation
•
9B
•
Updated
Aug 14, 2024
•
538
•
25
google/codegemma-2b-GGUF
Text Generation
•
3B
•
Updated
Jun 27, 2024
•
44
•
26
google/codegemma-7b-GGUF
Text Generation
•
9B
•
Updated
Jun 27, 2024
•
43
•
20
google/codegemma-7b-it-GGUF
Text Generation
•
9B
•
Updated
Jun 27, 2024
•
124
•
58
pacozaa/bonito-gguf
7B
•
Updated
Apr 14, 2024
•
21
pmking27/PrathameshLLM-2B-GGUF
3B
•
Updated
Apr 9, 2024
•
714
•
1
teleprint-me/cyberpunk-valerie-v0.1
Text Generation
•
0.1B
•
Updated
Apr 18, 2024
•
19
•
1
qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF
Text Generation
•
8B
•
Updated
Apr 29, 2024
•
1.13k
•
6
mgonzs13/Mistroll-7B-v2.2-GGUF
Text Generation
•
7B
•
Updated
Apr 29, 2024
•
46
mgonzs13/ladybird-base-7B-v8-GGUF
Text Generation
•
7B
•
Updated
Apr 29, 2024
•
83
google/codegemma-1.1-2b-GGUF
Text Generation
•
3B
•
Updated
Jun 27, 2024
•
8
•
1
google/codegemma-1.1-7b-it-GGUF
Text Generation
•
9B
•
Updated
Jun 27, 2024
•
50
•
14
openbmb/MiniCPM-Llama3-V-2_5-gguf
Updated
Feb 27
•
6.02k
•
213
mgonzs13/TextBase-7B-v0.1-GGUF
Text Generation
•
7B
•
Updated
Jun 11, 2024
•
96
QuantFactory/TextBase-7B-v0.1-GGUF
Text Generation
•
7B
•
Updated
Jun 18, 2024
•
83
njwright92/ComicBot_v.2-gguf
Text Generation
•
7B
•
Updated
Aug 30, 2024
•
67
Irathernotsay/qwen2-1.5B-medical_qa-Finetune
Text Generation
•
2B
•
Updated
Jul 17, 2024
•
17
palusi/Qwen2-0.5B-Instruct-GGUF
0.5B
•
Updated
Jun 27, 2024
•
127
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k
Text Generation
•
8B
•
Updated
Jul 9, 2024
•
19
ruslanmv/Medical-Llama3-v2-Q4_K_M-GGUF
8B
•
Updated
Jun 30, 2024
•
49
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF
Text Generation
•
8B
•
Updated
Jul 9, 2024
•
11
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ
Text Generation
•
2B
•
Updated
Jul 9, 2024
•
14
zhhan/Phi-3-mini-4k-instruct_gguf_derived
Summarization
•
4B
•
Updated
Jul 2, 2024
•
39
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ
Text Generation
•
2B
•
Updated
Jul 9, 2024
•
14
mgonzs13/stablelm-zephyr-3B-localmentor-GGUF
Text Generation
•
3B
•
Updated
Jul 3, 2024
•
330
google/gemma-2-2b-it-GGUF
3B
•
Updated
Aug 27, 2024
•
206
•
82
google/gemma-2-2b-GGUF
3B
•
Updated
Aug 2, 2024
•
100
•
17
Previous
1
2
3
4
...
7
Next