Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,519

Full-text search

Active filters: llama-cpp

Crow13/nvnv-alice-Q8_0-GGUF

Text Generation • Updated Apr 26, 2024 • 16 • 2

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 1, 2024 • 19 • 1

noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 7, 2024 • 21 • 2

openerotica/Llama-3-lima-nsfw-16k-test-GGUF

Updated May 17, 2024 • 634 • 7

v000000/Manticore-13b-Chat-Pyg-Guanaco-GGUFs

Updated Jul 4, 2024 • 19 • 1

newsletter/dolphin-2.7-mixtral-8x7b-Q6_K-GGUF

Updated Jun 5, 2024 • 13 • 2

v8karlo/UNCENSORED-TinyDolphin-2.8.1-1.1b-Q4_K_M-GGUF

Updated Jun 6, 2024 • 89 • 5

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • Updated Jun 6, 2024 • 260 • 7

v8karlo/UNCENSORED-TinyDolphin-3x-MoE-Q4_K_M-GGUF

Updated Jun 6, 2024 • 9 • 2

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q4_K_M-GGUF

Updated Jun 6, 2024 • 22 • 4

v8karlo/UNCENSORED-TinyDolphin-2.8-1.1b-Q5_K_M-GGUF

Updated Jun 6, 2024 • 3 • 3

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q5_K_M-GGUF

Updated Jun 6, 2024 • 104 • 2

albertodelazzari/Saul-7B-Instruct-v1-Q8_0-GGUF

Updated Jun 13, 2024 • 12 • 1

snower/omost-phi-3-mini-128k-Q4_K_M-GGUF

Updated Jun 24, 2024 • 13 • 2

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26, 2024 • 3.58k • 59

enacimie/gpt2-Q4_K_M-GGUF

Updated Jun 26, 2024 • 9 • 1

mtsdurica/madlad400-3b-mt-Q8_0-GGUF

Translation • Updated Jul 13, 2024 • 41 • 1

waltervix/OpenELM-3B-Instruct-Q2_K-GGUF

Updated Jul 20, 2024 • 17 • 1

YorkieOH10/Meta-Llama-3.1-8B-Instruct-hf-Q4_K_M-GGUF

Updated Jul 23, 2024 • 147 • 3

zhentaoyu/DeepSeek-V2-Lite-Chat-Q4_0-GGUF

Updated Jul 24, 2024 • 86 • 1

joshnader/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 24, 2024 • 31 • 1

Karsh-CAI/Peach-9B-8k-Roleplay-Q5_K_M-GGUF

Text Generation • Updated Aug 7, 2024 • 73 • 6

neifuisan/Gemma2-9b-Neuro-sama-Q4_K_M-GGUF

Text Generation • Updated Aug 12, 2024 • 46 • 3

neifuisan/Fimbulvetr-11B-v2-Neuro-sama-Q4_K_M-GGUF

Text Generation • Updated Aug 13, 2024 • 11 • 3

KimChen/bge-m3-GGUF

Sentence Similarity • Updated Aug 29, 2024 • 640 • 7

urkz/sarashina2-7b-Q4_K_M-GGUF

Updated Aug 22, 2024 • 5 • 1

KeyurRamoliya/multilingual-e5-large-instruct-GGUF

Updated Aug 23, 2024 • 189 • 3

rombodawg/Replete-LLM-V2-Llama-3.1-8b-Q4_0-GGUF

Updated Aug 25, 2024 • 8 • 1

jinao/secgpt-Q4_K_M-GGUF

Text Generation • Updated Aug 28, 2024 • 52 • 4

redhat6/Phi-3.5-mini-instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 3, 2024 • 48 • 2