Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

20,379

Full-text search

Active filters: llama-cpp

seawolf2357/Meta-Llama-3-70B-Instruct-Q4_K_M-GGUF

Text Generation • Updated May 14, 2024 • 129 • 2

jeiku/Puppy_Purpose_0.69-Q4_K_M-GGUF

Updated May 14, 2024 • 1

CheeseCoder/pythia-12b-deduped-Q4_K_M-GGUF

Updated May 15, 2024 • 7

Recaru/KULLM3-Q4_K_S-GGUF

Updated May 15, 2024 • 9

Sagicc/SFR-Iterative-DPO-LLaMA-3-8B-R-Q4_K_M-GGUF

Updated May 15, 2024 • 2 • 1

QiyuWu/DPO-Internlm2-1_8B-Q4_K_M-GGUF

Updated May 15, 2024 • 2 • 1

newsletter/Wiedervereinigung-7b-dpo-Q6_K-GGUF

Updated Jun 6, 2024

newsletter/Wiedervereinigung-7b-dpo-laser-Q6_K-GGUF

Updated Jun 6, 2024 • 12

krupakar-reddy/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 15, 2024 • 1

TomWest/falcon-11B-Q8_0-GGUF

Updated May 15, 2024 • 2

BICENG/CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • Updated May 15, 2024 • 1

int2eh/MAmmoTH2-7B-Plus-Q6_K-GGUF

Updated May 15, 2024

NikolayKozloff/EVA-GPT-German-v7-2-Beta-Q5_K_M-GGUF

Updated May 15, 2024 • 14 • 1

NikolayKozloff/Llama-2-7b-cnn-daily-mail-pruned_50-Q8_0-GGUF

Updated May 15, 2024 • 6 • 1

NikolayKozloff/Llama-2-7b-cnn-daily-mail-Q8_0-GGUF

Updated May 15, 2024 • 3 • 1

NikolayKozloff/Llama-2-7b-gsm8k-Q8_0-GGUF

Updated May 15, 2024 • 1 • 1

NikolayKozloff/Llama-2-7b-dolphin-open_platypus-Q8_0-GGUF

Text Generation • Updated May 15, 2024 • 6 • 1

ClaudioItaly/mergekit-slerp-ebgdloh-Q4_K_M-GGUF

Updated May 15, 2024 • 10

ClaudioItaly/JackRussell-Q4_K_M-GGUF

Updated May 16, 2024 • 1

krupakar-reddy/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated May 19, 2024

nchometton/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 16, 2024

openerotica/Llama-3-lima-nsfw-16k-test-GGUF

Updated May 17, 2024 • 326 • 7

linh5nb/Llama-2-7b-chat-startup-9-Q4_K_M-GGUF

Updated May 16, 2024 • 2

ClaudioItaly/mergekit-slerp-ebgdloh-Q5_K_M-GGUF

Updated May 16, 2024 • 3

cobrakenji/granite-20b-code-base-Q3_K_M-GGUF

Text Generation • Updated May 16, 2024 • 6

cobrakenji/granite-34b-code-base-Q2_K-GGUF

Text Generation • Updated May 16, 2024 • 7

noxinc/Mistral-portuguese-luana-7b-chat-Q8_0-GGUF-PTBR

Text Generation • Updated May 16, 2024 • 5

noxinc/Mistral-portuguese-luana-7b-Q8_0-GGUF-PTBR

Text Generation • Updated May 16, 2024 • 10

noxinc/Mistral-portuguese-luana-7b-mental-health-Q8_0-GGUF-PTBR

Text Generation • Updated May 16, 2024 • 11

Ransss/LLama-3-8b-Lexi-Iranian-Stories-PersianTherapist-Lumimaid-DARE_TIES-Q8_0-GGUF

Updated May 16, 2024 • 12