Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,088

Base only

Active filters: compression

kacaforyah/Opti-27B

Image-Text-to-Text • 27B • Updated 2 days ago • 1.63k • 10

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated Jan 28 • 25.8k • 275

Parda21/Qwen3-4B-NWC

Text Generation • 6B • Updated 5 days ago • 252 • 2

cyankiwi/GLM-4.7-Flash-REAP-23B-A3B-AWQ-8bit

Text Generation • 24B • Updated Jul 21 • 32 • 4

turintech/GLM-5.2-MaxMin108-GGUF

Text Generation • 325B • Updated 7 days ago • 597 • 6

Akicou/Qwen3.8-Flash-Next-REAM-60Pct

Text Generation • 129B • Updated 26 days ago • 604 • 7

Jeesup/svd-safety-l3_swift_remove30_swapgapiter_evfront_b010

Text Generation • 8B • Updated 2 days ago • 440 • 1

Parda21/Qwen3-0.6B-NWC

Text Generation • 0.8B • Updated 4 days ago • 236 • 1

Parda21/Qwen3-4B-NWC-fp8

Text Generation • 4B • Updated 4 days ago • 42 • 1

Jeesup/svd-safety-gemma2_9b_it_swift_remove20

Text Generation • 9B • Updated 3 days ago • 176 • 1

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 18

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 28

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 19

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 28

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 22

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 21

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 43

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 22

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 20

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 13

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 20

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 21

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli

Updated Jul 31, 2022 • 18