Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

419

Base only

Active filters: cuda

5ivatej/tinyllama-1.1b-early-exit

Text Generation • Updated Sep 10, 2025

jackal79/gpt2-ibce-lowrank-192

Text Generation • Updated Sep 19, 2025 • 7

kernels-community/sage_attention

Updated Mar 5 • 28 • 3

kernels-community/torch_harmonics_attn

Updated Oct 27, 2025 • 8 • 1

kernels-community/residual_rms_rocm

Updated Oct 27, 2025 • 6 • 1

Savyasaachin/Qwen3-Shining-Lucy-CODER-3.4B-Brainstorm20x-e32-Q8_0-GGUF

Text Generation • 3B • Updated Oct 7, 2025 • 35 • 1

arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit

Text Generation • 1B • Updated Oct 20, 2025 • 9

Yehor/kulyk-sif

Text Generation • Updated Oct 21, 2025

PangaiaSoftware/YanoljaNEXT-Rosetta-4B-onnx

Translation • Updated Oct 21, 2025 • 5 • 2

AhmedAyman/k2-think-cuda-1505

Text Generation • Updated Oct 26, 2025 • 5

Eltamuan/Gravitas-Torch-2.8-Blackwell-Edition

Updated Nov 3, 2025

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 12

ValiantLabs/Ministral-3-14B-Reasoning-2512-ShiningValiant3

Text Generation • 14B • Updated Dec 8, 2025 • 16 • 5

sequelbox/Ministral-3-14B-Reasoning-2512-PlumEsper1.1

Image-Text-to-Text • 14B • Updated Dec 9, 2025 • 11 • 3

mradermacher/Ministral-3-14B-Reasoning-2512-ShiningValiant3-GGUF

14B • Updated Dec 9, 2025 • 113

mradermacher/Ministral-3-14B-Reasoning-2512-ShiningValiant3-i1-GGUF

14B • Updated Dec 9, 2025 • 703 • 1

mradermacher/Ministral-3-14B-Reasoning-2512-PlumEsper1.1-GGUF

14B • Updated Dec 21, 2025 • 183 • 2

introvoyz041/Ministral-3-14B-Reasoning-2512-ShiningValiant3-mlx-4Bit

Text Generation • 14B • Updated Dec 11, 2025 • 35 • 1

Stan31/quantumflow-prototypes

Updated Dec 19, 2025

mradermacher/Ministral-3-14B-Reasoning-2512-PlumEsper1.1-i1-GGUF

14B • Updated Dec 21, 2025 • 688 • 3

JusteLeo/Nunchaku-Zimage-Win-Wheels

Updated Jan 12 • 28

waqasm86/llcuda-models

Text Generation • 1.0B • Updated Dec 29, 2025 • 4

Hellohal2064/vllm-dgx-spark-gb10

Text Generation • Updated Jan 6 • 9

White2Hand/flash-attention-v2.8.3-blackwell-windows

Updated Jan 5 • 1

aydin99/FLUX.2-klein-4B-int8

Text-to-Image • 4B • Updated Jan 15 • 733 • 12

Infatoshi/kernrl-training

Reinforcement Learning • Updated Jan 20 • 1

krisaujla/BitLinear

Other • Updated Jan 20 • 2

raipolymath/triton-windows

Updated Jan 23 • 1

Jarrodbarnes/KernelBench-RLVR-120b

Text Generation • 117B • Updated Feb 10 • 23 • 3

waqasm86/llamatelemetry-binaries