Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

37,113

Full-text search

Active filters: bitsandbytes

fantos/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 20 • 391 • 18

ginipick/QwQ-32B-NF4

Text Generation • Updated Mar 21 • 107 • 22

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Feb 27 • 102k • 81

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 55.2k • 56

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 5 • 172 • 2

unsloth/Qwen3-14B-unsloth-bnb-4bit

Text Generation • Updated about 4 hours ago • 48.2k • 5

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 42 • 30

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 46 • 1

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 54.2k • 11

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 601 • 5

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 9 • 2

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22, 2024 • 138 • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 606 • 37

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated Feb 28 • 27 • 1

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 105 • 8

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10, 2024 • 36 • 55

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 37 • 11

ruslanmv/llama3-8B-medical

Text Generation • Updated May 15, 2024 • 88 • 11

hoang1123/llam3-8b-4bit-unsloth

Text Generation • Updated Apr 25, 2024 • 57 • 1

Ostixe360/Qwen-Audio-nf4

Text Generation • Updated Apr 25, 2024 • 139 • 1

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 16 • 3

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 197 • 26

totally-not-an-llm/babelfish-1.1b-v0.1-qlora

Updated Apr 30, 2024 • 1 • 1

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 21 • 9

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 29k • 75

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.78k • 6

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 6 • 1

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 1.25k • 21

lllyasviel/omost-dolphin-2.9-llama3-8b-4bits

Text Generation • Updated May 29, 2024 • 124 • 6

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 45 • 7