Models

rednote-hilab/dots.llm1.inst-FP8-dynamic

Text Generation • 1B • Updated 4 days ago • 30 • 4

boboliu/Qwen3-Embedding-0.6B-W4A16-G128

Feature Extraction • 0.2B • Updated 21 days ago • 213 • 2

allenai/olmOCR-7B-0225-preview-FP8

Image-Text-to-Text • 8B • Updated 11 days ago • 488 • 6

justinjja/MiniMax-M1-80k-W4A16-INT4

Text Generation • 79B • Updated 5 days ago • 40 • 2

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated 2 days ago • 155 • 2

RedHatAI/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • 11B • Updated Oct 2, 2024 • 4.57k • 24

RedHatAI/pixtral-12b-FP8-dynamic

Text Generation • 13B • Updated Feb 7 • 72.4k • 10

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic

71B • Updated Dec 6, 2024 • 2.83k • 12

novita-ai/dolphin-2.9.2-qwen2-72b-fp8

73B • Updated Jan 16 • 2.04k • 1

root-signals/RootSignals-Judge-Llama-70B

Text Generation • 71B • Updated Feb 19 • 1.78k • 16

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • 33B • Updated Feb 27 • 3.54k • 11

RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Apr 3 • 41.9k • 3

Yehor/whisper-large-v3-turbo-quantized-uk

0.2B • Updated Mar 23 • 92 • 1

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Apr 6 • 3.66k • 14

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • 3B • Updated Apr 13 • 28.2k • 5

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 5B • Updated 29 days ago • 4.22k • 5

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • 6B • Updated May 13 • 3.9k • 7

bullerwins/Devstral-Small-2505-fp8

Text2Text Generation • 24B • Updated May 21 • 796 • 4

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • 13B • Updated 19 days ago • 366 • 1

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • 29B • Updated 19 days ago • 632 • 5

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated 19 days ago • 692 • 1

boboliu/Qwen3-Embedding-8B-W4A16-G128

Feature Extraction • 2B • Updated 21 days ago • 324 • 1

noneUsername/Mistral-Small-3.2-24B-Instruct-hf-W8A8

24B • Updated 5 days ago • 44 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 23

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 25

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • 0.3B • Updated Oct 10, 2024 • 35

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 50

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 86

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • 1B • Updated Oct 9, 2024 • 21

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 44