RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text • 109B • Updated • 15.4k • 31
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
473
Active filters: llmcompressor
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g
Image-Text-to-Text • 4B • Updated • 851 • 7
ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g
Image-Text-to-Text • 12B • Updated • 5.19k • 7
adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8
Text Generation • Updated • 12 • 1
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 3.85k • 10
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 810 • 5
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation • 676B • Updated • 7.16k • 7
NoorNizar/Llama-3.2-3B-Instruct-WINT8
Text Generation • 4B • Updated • 9
NoorNizar/Meta-Llama-3-8B-Instruct-WFP8
Text Generation • 8B • Updated • 7
NoorNizar/Meta-Llama-3-8B-Instruct-WINT8
Text Generation • 8B • Updated • 5
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text • 109B • Updated • 19.7k • 13
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation • 4B • Updated • 13.5k • 4
RedHatAI/Qwen3-32B-FP8-dynamic
Text Generation • 33B • Updated • 51.9k • 15
RedHatAI/Qwen3-0.6B-FP8-dynamic
Text Generation • 0.8B • Updated • 388 • 1
RedHatAI/Qwen3-4B-FP8-dynamic
Text Generation • 4B • Updated • 716 • 1
RedHatAI/Qwen3-14B-FP8-dynamic
Text Generation • 15B • Updated • 1k • 4
RedHatAI/Qwen3-1.7B-FP8-dynamic
Text Generation • 2B • Updated • 8.79k
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation • 2B • Updated • 5.09k • 3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation • 0.8B • Updated • 4.28k
NoorNizar/Phi-4-mini-instruct-WINT4
Text Generation • 4B • Updated • 8
NoorNizar/Meta-Llama-3-8B-Instruct-WINT4
Text Generation • 8B • Updated • 8
NoorNizar/Llama-3.2-3B-Instruct-WINT4
Text Generation • 4B • Updated • 16
RedHatAI/Qwen3-30B-A3B-FP8-dynamic
Text Generation • 31B • Updated • 2.25k • 3
mratsim/GLM-4-32B-0414.w4a16-gptq
Text Generation • 33B • Updated • 294 • 3
RedHatAI/Qwen3-235B-A22B-FP8-dynamic
Text Generation • 235B • Updated • 53 • 2
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation • 33B • Updated • 7.15k • 12
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation • 15B • Updated • 1.93k • 1
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation • 8B • Updated • 24.9k • 5
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation • 31B • Updated • 17.7k • 7
BCCard/Qwen3-32B-FP8-Dynamic
Text Generation • 33B • Updated • 24 • 1