Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,685

Full-text search

Active filters: llama-cpp

aifeifei798/Phi-3-song-lyrics-1.1-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 22 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15, 2024 • 61 • 2

NikolayKozloff/h2o-danube3-4b-base-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 1 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28, 2024 • 59 • 3

NikolayKozloff/h2o-danube3-500m-base-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 2 • 2

PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct-Q4_K_M-GGUF

Updated Jul 17, 2024 • 4

clarkguilty/cosmosage-v3-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 2

clarkguilty/cosmosage-v3-Q6_K-GGUF

Text Generation • Updated Jul 15, 2024 • 1

VAIBHAV22334455/NOVA-3B.v2-Q8_0-GGUF

Updated Jul 15, 2024 • 2

Lancer1408/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF

Updated Jul 15, 2024 • 1

plehrman24/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 4

vincentl2189/RolePlayLake-7B-Toxic-Q5_K_M-GGUF

Updated Jul 15, 2024 • 2

plehrman24/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 15, 2024 • 1

Ransss/L3-15B-MythicalMaid-t0.0001-Q8_0-GGUF

Updated Jul 15, 2024 • 3

Ransss/L3-15B-MythicalMaid-t0.0001-Q6_K-GGUF

Updated Jul 15, 2024 • 4

Ransss/L3-8B-Tamamo-v1-Q8_0-GGUF

Updated Jul 15, 2024 • 1 • 1

reach-vb/NuminaMath-7B-TIR-Q8_0-GGUF

Text Generation • Updated Jul 15, 2024 • 5 • 24

bazsalazas/Mistral-7B-v0.3-Q4_K_M-GGUF

Updated Jul 15, 2024 • 1

Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF

Updated Jul 15, 2024 • 1

Alex01837178373/gemma-2-9b-it-abliterated-IQ3_M-GGUF

Updated Jul 15, 2024 • 10

Alex01837178373/gemma-2-9b-it-abliterated-Q4_K_M-GGUF

Updated Jul 15, 2024 • 7

Aldaris/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

Updated Jul 16, 2024 • 17

Aldaris/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

Updated Jul 16, 2024 • 3

qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • Updated Jul 16, 2024 • 6

KnutJaegersberg/gemma-2-9b-it-abliterated-Q8_0-GGUF

Updated Jul 16, 2024 • 24 • 1

Bhargav3514/Fox-1-1.6B-Instruct-v0.1-Q4_K_M-GGUF

Updated Jul 16, 2024 • 3

amitj1jan/Meta-Llama-3-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 16, 2024

Cran-May/Chinese-LLaMA-2-13B-hf-Q4_K_M-GGUF

Updated Jul 16, 2024 • 3

martintomov/NuminaMath-7B-TIR-Q4_K_M-GGUF

Text Generation • Updated Jul 16, 2024 • 1

martintomov/NuminaMath-7B-TIR-Q8_0-GGUF

Text Generation • Updated Jul 16, 2024 • 3