-
-
-
-
-
-
Inference Providers
Active filters:
gptq
baichuan-inc/Baichuan-M2-32B-GPTQ-Int4
Text Generation
•
6B
•
Updated
•
457
•
3
xiangxinai/Xiangxin-Guardrails-Text
Text Classification
•
3B
•
Updated
•
48
•
2
TheBloke/Mistral-7B-v0.1-GPTQ
Text Generation
•
1B
•
Updated
•
382
•
37
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation
•
10B
•
Updated
•
149
•
8
neboolaai/NAI-3.5
Text Generation
•
1B
•
Updated
•
16
•
6
TheBloke/EstopianMaid-13B-GPTQ
Text Generation
•
2B
•
Updated
•
46
•
18
Qwen/Qwen1.5-4B-Chat-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
99
•
6
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
2B
•
Updated
•
30.5k
•
36
Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
1B
•
Updated
•
3.43k
•
25
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
14k
•
21
Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
2.76k
•
5
hfl/Qwen2.5-VL-7B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
3B
•
Updated
•
1.55k
•
5
FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit
Any-to-Any
•
5B
•
Updated
•
27
•
54
Qwen/Qwen3-235B-A22B-GPTQ-Int4
Text Generation
•
Updated
•
12.5k
•
22
JunHowie/Skywork-OR1-32B-GPTQ-Int4
6B
•
Updated
•
3
•
1
QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix
Text Generation
•
Updated
•
181
•
4
QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
2.96k
•
3
tencent/Hunyuan-7B-Instruct-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
229
•
5
QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
831
•
2
TheBloke/X-MythoChronos-13B-GPTQ
Text Generation
•
2B
•
Updated
•
7
•
5
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
19
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
16
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
33
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
21
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
16
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
17
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
19
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
54
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
2.03k
•
21
TheBloke/koala-13B-HF
Text Generation
•
Updated
•
2.19k
•
41