Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,913

Full-text search

Active filters: gptq

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 2 days ago • 1.98k • 6

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 2 days ago • 379 • 4

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • Updated 14 days ago • 293 • 2

Qwen/Qwen3-0.6B-GPTQ-Int8

Text Generation • Updated 2 days ago • 163 • 2

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 72 • 40

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 660 • 195

TheBloke/GPT4All-13B-snoozy-GPTQ

Text Generation • Updated Aug 21, 2023 • 156 • 33

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.43k • 320

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 29 • 23

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 310 • 66

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 360 • 580

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 120 • 87

TheBloke/chronos-hermes-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 160 • 33

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 18.3k • 265

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.36k • 364

TheBloke/llama2_7b_chat_uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 116 • 69

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.31k • 204

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25, 2024 • 2.31k • 91

TheBloke/Baichuan2-13B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 76 • 21

TheBloke/Falcon-180B-GPTQ

Text Generation • Updated Sep 27, 2023 • 71 • 9

TheBloke/airoboros-l2-13B-2.2.1-GPTQ

Text Generation • Updated Sep 27, 2023 • 13 • 2

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 8.39k • 81

TheBloke/deepseek-coder-6.7B-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 291 • 25

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 102 • 112

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 76 • 5

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31, 2024 • 37 • 20

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 17 • 10

thesven/Mistral-7B-Instruct-v0.3-GPTQ

Text Generation • Updated Sep 11, 2024 • 6.71k • 1

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 287 • 4

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9, 2024 • 304 • 27