Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,667

Full-text search

Active filters: llama-cpp

cleatherbury/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • Updated Jul 18, 2024 • 4

martintomov/gemma-2-9b-Q4_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 1

martintomov/h2o-danube-1.8b-chat-Q8_0-GGUF

Text Generation • Updated Jul 18, 2024 • 1

martintomov/h2o-danube3-4b-chat-Q8_0-GGUF

Text Generation • Updated Jul 18, 2024 • 4

martintomov/h2o-danube3-4b-base-Q8_0-GGUF

Text Generation • Updated Jul 18, 2024 • 4

godolike/deepseek-coder-6.7b-instruct-Q4_K_M-GGUF

Updated Jul 18, 2024 • 375

MugenYume/Phi-3-mini-4k-instruct-IQ4_NL-GGUF

Text Generation • Updated Jul 18, 2024 • 5

MugenYume/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 2

MugenYume/Phi-3-mini-4k-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 3

alanrios2001/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 2

alanrios2001/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 2

hpcgroup/hpc-coder-v2-6.7b-Q8_0-GGUF

Updated Jul 18, 2024 • 8 • 1

hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF

Updated Jul 18, 2024 • 5 • 1

aifeifei798/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 7

aifeifei798/Phi-3-mini-4k-instruct-IQ4_NL-GGUF

Text Generation • Updated Jul 18, 2024 • 5

jdumanski/gpt2-Q4_K_M-GGUF

Updated Jul 18, 2024 • 2

jdumanski/gpt2-medium-Q4_K_M-GGUF

Updated Jul 18, 2024 • 9

jdumanski/gpt2-large-Q4_K_M-GGUF

Updated Jul 18, 2024 • 5

jdumanski/gpt2-xl-Q4_K_M-GGUF

Updated Jul 18, 2024

kucukkanat/gemma-2-9b-Q4_K_M-GGUF

Text Generation • Updated Jul 18, 2024 • 1

lopezhansel/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • Updated Jul 18, 2024

mbahrsnc/mini-mcqueen-Q2_K-GGUF

Updated Jul 18, 2024 • 2

mbahrsnc/mini-mcqueen-Q4_K_M-GGUF

Updated Jul 19, 2024 • 8

justforreg/gemma-2-9b-Q8_0-GGUF

Text Generation • Updated Jul 19, 2024 • 5

lopezhansel/phined-tuned-2-Q8_0-GGUF

Text Generation • Updated Jul 19, 2024 • 10 • 1

marcnnn/Llama3-German-8B-Q8_0-GGUF

Updated Jul 19, 2024 • 3

jaahas/gemma-2-9b-it-abliterated-Q5_K_M-GGUF

Updated Jul 19, 2024 • 3

RahulPant/lora_model_mistral_16_merged-Q8_0-GGUF

Updated Jul 19, 2024 • 1

Theta-Lev/deepseek-math-7b-base-Q8_0-GGUF

Updated Jul 19, 2024 • 8

rumbleFTW/gemma-2-9b-Q8_0-GGUF

Text Generation • Updated Jul 19, 2024 • 2