Red Hat AI

company

Verified

https://www.redhat.com/en/products/ai

RedHat_AI

AI & ML interests

OpenSource and AI

Recent Activity

mgoin new activity about 6 hours ago

RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8:Not working with vLLM 0.9.1

nm-research updated a model 1 day ago

RedHatAI/Llama-4-Scout-17B-16E-NVFP4

nm-research updated a model 1 day ago

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

View all activity

RedHatAI 's models 490

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation • 14B • Updated Oct 9, 2024 • 18 • 2

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16

Text Generation • 4B • Updated Oct 9, 2024 • 7 • 2

RedHatAI/Phi-3-medium-128k-instruct-FP8

Text Generation • 14B • Updated Oct 9, 2024 • 7 • 5

RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a16

9B • Updated Oct 9, 2024 • 5

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a16

3B • Updated Oct 9, 2024 • 8

RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a16

0.4B • Updated Oct 9, 2024 • 5

RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a8

73B • Updated Oct 9, 2024 • 12

RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a8

33B • Updated Oct 9, 2024 • 24

RedHatAI/Llama-3.2-1B-FP8

1B • Updated Oct 9, 2024 • 30

RedHatAI/Qwen2.5-32B-quantized.w8a8

33B • Updated Oct 9, 2024 • 12

RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • 406B • Updated Oct 9, 2024 • 2.57k • 31

RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8

3B • Updated Oct 9, 2024 • 36

RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8

2B • Updated Oct 9, 2024 • 7

RedHatAI/SparseLlama-3-8B-pruned_50.2of4

Text Generation • 8B • Updated Oct 4, 2024 • 30

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • 89B • Updated Oct 2, 2024 • 4.37k • 10

RedHatAI/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • 11B • Updated Oct 2, 2024 • 3.96k • 24

RedHatAI/Phi-3.5-mini-instruct-FP8-KV

Text Generation • 4B • Updated Oct 1, 2024 • 40 • 2

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation • 11B • Updated Aug 29, 2024 • 2.62k • 2

RedHatAI/SmolLM-135M-q

Updated Aug 23, 2024

RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8

Text Generation • 141B • Updated Aug 12, 2024 • 8 • 3

RedHatAI/DeepSeek-Coder-V2-Base-FP8

Text Generation • 236B • Updated Jul 22, 2024 • 23

RedHatAI/DeepSeek-Coder-V2-Instruct-FP8

Text Generation • 236B • Updated Jul 22, 2024 • 1.25k • 7

RedHatAI/Mistral-Nemo-Instruct-2407-FP8

Text Generation • 12B • Updated Jul 19, 2024 • 1.27k • 18

RedHatAI/Qwen2-57B-A14B-Instruct-FP8

Text Generation • 57B • Updated Jul 18, 2024 • 1.41k • 1

RedHatAI/Llama-2-7b-chat-hf-FP8

Text Generation • 7B • Updated Jul 18, 2024 • 1.15k

RedHatAI/Mistral-7B-Instruct-v0.3-FP8

Text Generation • 7B • Updated Jul 18, 2024 • 1.88k • 2

RedHatAI/Qwen2-0.5B-Instruct-FP8

Text Generation • 0.5B • Updated Jul 18, 2024 • 1.41k • • 3

RedHatAI/Qwen2-1.5B-Instruct-FP8

Text Generation • 2B • Updated Jul 18, 2024 • 4.43k •

RedHatAI/Qwen2-7B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 14.5k • 2

RedHatAI/Qwen2-72B-Instruct-FP8

Text Generation • 73B • Updated Jul 18, 2024 • 1.52k • 15