Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

136

Base only

Active filters: sglang

Ex0bit/Qwen3.6-27B-PRISM-EAGLE3

Text Generation • Updated 12 days ago • 8

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 45.3k • 26

AxionML/Qwen3.5-9B-NVFP4

Image-Text-to-Text • 7B • Updated Mar 3 • 815k • 17

Zhongzhu/OSCAR-RotationZoo

Text Generation • Updated 11 days ago • 4

SurfaceData/llava-v1.6-mistral-7b-sglang

Image-Text-to-Text • 8B • Updated Mar 7, 2024 • 18 • 9

SurfaceData/llava-v1.6-vicuna-7b-sglang

Image-Text-to-Text • 7B • Updated Mar 7, 2024 • 27 • 1

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • 73B • Updated May 12, 2025 • 61 • 2

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • 69B • Updated May 12, 2025 • 60

alvarobartt/grok-2-tokenizer

Updated Aug 27, 2025 • 3

unsloth/grok-2

Text Generation • Updated Sep 6, 2025 • 115 • 5

osmapi/MiniMax-M2-THRIFT

173B • Updated Nov 13, 2025 • 1.4k • 35

mradermacher/MiniMax-M2-THRIFT-GGUF

Updated Apr 28 • 2

JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit

Text Generation • 49B • Updated Nov 5, 2025 • 6 • 1

mradermacher/MiniMax-M2-THRIFT-i1-GGUF

173B • Updated Apr 28 • 71 • 10

bartowski/VibeStudio_MiniMax-M2-THRIFT-GGUF

Text Generation • 173B • Updated Nov 20, 2025 • 414 • 8

osmapi/MiniMax-M2-THRIFT-55

106B • Updated Dec 3, 2025 • 149 • 5

JinnP/SGLang-EAGLE3-Qwen3-Coder-30B-A3B-Instruct

Text Generation • 0.2B • Updated Nov 25, 2025 • 10 • 2

mradermacher/MiniMax-M2-THRIFT-55-GGUF

106B • Updated Apr 18 • 31 • 2

mradermacher/MiniMax-M2-THRIFT-55-i1-GGUF

106B • Updated Apr 19 • 389 • 2

osmapi/MiniMax-M2-THRIFT-55-MLX-4bit

106B • Updated Dec 2, 2025 • 23 • 2

osmapi/MiniMax-M2-THRIFT-55-MLX-6bit

106B • Updated Dec 3, 2025 • 24

Doradus-AI/MiroThinker-v1.0-30B-FP8

Text Generation • 31B • Updated Dec 5, 2025 • 8 • 4

Doradus-AI/Hermes-4.3-36B-FP8

Text Generation • 36B • Updated Dec 7, 2025 • 262 • 3

Doradus-AI/RnJ-1-Instruct-FP8

Text Generation • 9B • Updated Dec 7, 2025 • 534k • 4

QuantTrio/Kimi-K2.5-E304

Image-Text-to-Text • 841B • Updated Feb 2 • 386 • 3

QuantTrio/Qwen3-Coder-Next-E336

Text Generation • 53B • Updated Feb 6 • 128 • 2

QuantTrio/Qwen3-Coder-Next-E400

Text Generation • 63B • Updated Feb 6 • 10 • 2

elon-trump/pixtral-12b-2409-w4a16-gptq

3B • Updated Apr 25

AxionML/Qwen3.5-122B-A10B-NVFP4

Image-Text-to-Text • 62B • Updated Mar 3 • 503 • 5

AxionML/Qwen3.5-0.8B-Base-NVFP4

Image-Text-to-Text • 0.7B • Updated Mar 3 • 52