Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

18

Full-text search

Active filters: local

chatpdflocal/llama3.1-8b-gguf

8B • Updated Dec 27, 2024 • 804 • 29

askfjhaskjgh/UbermenschetienASI

Text Generation • 8B • Updated Sep 17 • 174 • 5

cebas/oneClick_Windows_ImageTo3D_install

Text-to-3D • Updated May 27, 2024 • 16

TroyDoesAI/Codestral-21B-Pruned

Text Generation • 21B • Updated Jun 1, 2024 • 1 • 2

mradermacher/Codestral-21B-Pruned-GGUF

21B • Updated Jun 1, 2024 • 260

mradermacher/Codestral-21B-Pruned-i1-GGUF

21B • Updated Aug 2, 2024 • 451

chatpdflocal/gemma2-instruct-gguf

3B • Updated Dec 27, 2024 • 33 • 7

chatpdflocal/mistral-nemo-instruct-gguf

12B • Updated Dec 27, 2024 • 74 • 5

chatpdflocal/phi-3.5-mini-instruct-gguf

4B • Updated Dec 27, 2024 • 62 • 1

chatpdflocal/Marco-o1-GGUF

8B • Updated Dec 27, 2024 • 56 • 2

chatpdflocal/QwQ-32B-Preview-GGUF

33B • Updated Dec 27, 2024 • 62 • 1

chatpdflocal/deepseek-r1-distill-llama-8b-gguf

8B • Updated Feb 27 • 4

chatpdflocal/deepseek-r1-distill-qwen-7b-gguf

8B • Updated Feb 27 • 12

chatpdflocal/QwQ-32B-GGUF

33B • Updated Mar 6 • 39 • 2

chatpdflocal/gemma-3-12b-it-gguf

12B • Updated Aug 19 • 77 • 3

chatpdflocal/gemma-3-27b-it-gguf

27B • Updated Mar 12 • 11 • 2

Writer/Palmyra-local-1_7B

2B • Updated Apr 7 • 1

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated 25 days ago • 58.2k • 4