Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

60

Base only

Active filters: mesh-llm

meshllm/Qwen3.8-27B-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated 10 days ago • 21.2k • 1

meshllm/gemma-3-1b-it-parity-f16-gguf

Text Generation • 1.0B • Updated Apr 6 • 13

meshllm/gemma-3-1b-it-parity-bf16-mlx

Text Generation • 1.0B • Updated Apr 6 • 12

meshllm/qwen3-0.6b-parity-q8_0-gguf

0.8B • Updated Apr 6 • 9

meshllm/qwen3-0.6b-parity-8bit-mlx

0.6B • Updated Apr 6 • 6

meshllm/gemma-2-2b-it-parity-q8_0-gguf

3B • Updated Apr 6 • 11

meshllm/gemma-2-2b-it-parity-8bit-mlx

3B • Updated Apr 6 • 10

meshllm/qwen3-8b-parity-q8_0-gguf

8B • Updated Apr 12 • 13 • 2

exdysa/Phi-4-reasoning-plus-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jun 1 • 448

exdysa/NousCoder-14B-Q4_K_M-layers

Text Generation • 0.3B • Updated Jun 1 • 317

exdysa/INTELLECT-3-Q4_K_M-layers

Text Generation • 0.2B • Updated Jun 1 • 1.15k

ilya-chak/gemma-4-12B-it-qat-GGUF-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated Jun 10 • 1.6k

meshllm/GLM-4.7-Flash-MTP-GGUF

Text Generation • 31B • Updated Jul 1 • 646

meshllm/glm-4.7-flash-spd-sidecar

Text Generation • Updated Jun 19

ashton25549/gemma-4-26B-A4B-it-UD-Q4_K_M-layers

Text Generation • 0.8B • Updated Jul 1 • 719

LucianoM39/flushnet-local-llama-3.1-8b-q4km-layers

0.2B • Updated Jul 2 • 393

LucianoM39/Qwen3.6-35B-A3B-UD-Q4_K_XL-Mesh-LLM

Text Generation • 0.8B • Updated Jul 18 • 1.1k

LucianoM39/Gemma-4-E4B-it-Q4_0-Mesh-LLM

0.1B • Updated Jul 20 • 2.09k

baselquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Jul 27

baselquant/inkling-UD-Q2_K_XL-layers-base

Image-Text-to-Text • 0.6B • Updated Jul 27

usterquant/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 4

usterquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 4

lyssquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 9 • 2.94k

lyssquant/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 9 • 2.59k

lyssquant/GLM-5.2-Q2_K-MTP-Q8-layers

Text Generation • 0.4B • Updated Aug 9 • 3.12k

shaffhausen/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 11 • 1.06k

shaffhausen/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 11 • 722

shaffhausenquant/Kimi-K2.7-Code-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Aug 11 • 485

namepd/Qwen3-VL-8B-Instruct-Q4_K_M-layers

Image-Text-to-Text • 0.2B • Updated Aug 12 • 565

meshllm/qwen3-0.6b-4bit-aimodel

Text Generation • Updated Aug 12