Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

21

Full-text search

Active filters: claude

mradermacher/Claudette-7B-GGUF

Updated Feb 13 • 304 • 3

Delta-Vector/Rei-V2-12B

Text Generation • Updated Mar 31 • 101 • • 12

ehristoforu/ReAssistant

Text Generation • Updated Nov 29, 2024

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q2_K-GGUF

Text Generation • Updated Jan 29 • 4

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q6_K-GGUF

Text Generation • Updated Jan 29 • 8

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q8_0-GGUF

Text Generation • Updated Jan 29 • 29

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q3_K_L-GGUF

Text Generation • Updated Jan 29 • 4

ayan4m1/Llama3.1-8B-Sonnet

Text Generation • Updated Feb 10 • 34 • 1

mradermacher/Llama3.1-8B-Sonnet-GGUF

Updated Feb 11 • 244

ayan4m1/Llama3.1-8B-Sonnet-GGUF

Text Generation • Updated Feb 12 • 39

ayan4m1/Claudette-7B

Text Generation • Updated Feb 13 • 10 • 2

mradermacher/Claudette-7B-i1-GGUF

Updated Feb 13 • 411 • 2

Delta-Vector/Rei-V2-12B-EXL2

Text Generation • Updated Mar 31 • 3

mradermacher/Rei-V2-12B-GGUF

Updated Mar 31 • 341 • 1

mradermacher/Rei-V2-12B-i1-GGUF

Updated Mar 31 • 1.01k • 1

Triangle104/Rei-V2-12B-Q4_K_S-GGUF

Text Generation • Updated Apr 8 • 8

Triangle104/Rei-V2-12B-Q4_K_M-GGUF

Text Generation • Updated Apr 8 • 7

Triangle104/Rei-V2-12B-Q5_K_S-GGUF

Text Generation • Updated Apr 8 • 4

Triangle104/Rei-V2-12B-Q5_K_M-GGUF

Text Generation • Updated Apr 8 • 7

Triangle104/Rei-V2-12B-Q6_K-GGUF

Text Generation • Updated Apr 8 • 7

Triangle104/Rei-V2-12B-Q8_0-GGUF

Text Generation • Updated Apr 8 • 8