Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

660

Full-text search

Active filters: vllm

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 5 days ago • 105k • • 1.21k

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 4 days ago • 28.2k • 54

mistralai/Mistral-Small-24B-Instruct-2501

Text Generation • Updated Feb 2 • 682k • • 911

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 753 • 16

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 337 • 14

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 764 • 16

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • Updated Mar 13 • 2.96k • 98

mistralai/Mistral-Small-3.1-24B-Base-2503

Updated Mar 19 • 15.5k • 212

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated about 7 hours ago • 9.42k • 12

mistralai/Pixtral-12B-Base-2409

Updated Feb 2 • 100

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated Apr 10 • 32.1k • • 324

VinkuraAI/KunoRZN-Llama-3-3B

Text Generation • Updated 28 days ago • 9.57k • 4

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 4.25k • 8

RedHatAI/Meta-Llama-3-70B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 4.8k • 12

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Mar 25 • 59.2k • 45

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 7.23k • 16

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 9.77k • 830

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 43.2k • 27

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 37.7k • 20

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 213 • 1

mistralai/Pixtral-12B-2409

Image-Text-to-Text • Updated Dec 26, 2024 • • 632

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 8.73k • 384

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 84.7k • 487

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 7.89k • 218

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated Mar 16 • 410

redhat6/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated Dec 23, 2024 • 4 • 1

nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache

Image-Text-to-Text • Updated Jan 6 • 22 • 1

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • Updated Jan 5 • 17 • 1

nintwentydo/pixtral-12b-2409-W4A16-G128

Image-Text-to-Text • Updated Jan 5 • 13 • 2

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated Jan 22 • 22.4k • 6