Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

25,310

Full-text search

Active filters: 8-bit

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated 13 days ago • 88.8k • 990

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 15 days ago • 124k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 14 days ago • 122k • 3

Qwen/Qwen3-0.6B-GPTQ-Int8

Text Generation • Updated 2 days ago • 163 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 20 • 21

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 42 • 30

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 46 • 1

lavawolfiee/Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation • Updated Dec 30, 2023 • 321 • 28

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 601 • 5

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 108 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 105 • 8

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 492 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 189 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.14k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 309k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.59k • 127

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.3k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 328k • 89

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 21 • 9

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 339k • 96

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 6 • 1

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 45 • 7

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 287 • 4

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 314k • 44

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.95k • 36

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 300k • 19

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 7.23k • 16

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26, 2024 • 18.4k • 21

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 37.7k • 20

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8

Updated Aug 7, 2024 • 39 • 2