Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

72

Full-text search

Active filters: sparsity

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 5

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 25 • 1

RedHatAI/Sparse-Llama-3.1-8B-2of4

Text Generation • 8B • Updated Dec 16, 2024 • 51 • 62

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 6 • 3

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 9 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 7 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 8

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 5

bartowski/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 26, 2024 • 209 • 3

QuantFactory/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 27, 2024 • 49 • 4

tensorblock/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated 28 days ago • 408

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • 13B • Updated Jan 5 • 2 • 1