-
-
-
-
-
-
Inference Providers
Active filters:
4bit
btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit
Text Generation
•
5B
•
Updated
•
923
•
3
BioMistral/BioMistral-7B-BnB.4
Text Generation
•
4B
•
Updated
•
28
•
1
taetae030/fin-term-model
5B
•
Updated
•
22
•
1
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
•
4B
•
Updated
•
2.22k
•
2
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
53
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
20
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
13
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
13
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
13
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
19
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
9
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
14
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
8
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
8
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
9
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
11
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
•
8
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
•
9
SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
7
•
8
SebastianSchramm/UniNER-7B-type-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
7
•
1
SebastianSchramm/UniNER-7B-definition-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
14
•
1
SebastianSchramm/UniNER-7B-type-sup-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
5
Sanrove/gpt2-GPTQ-4b
Text Generation
•
Updated
•
4
kingabzpro/zephyr-7b-beta-Agent-Instruct
Text Generation
•
Updated
•
3
•
1
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
5
•
2
A2H0H0R1/Qwen-7B-Chat-Int4-Qlora-biology
Text Generation
•
Updated
•
3
kingabzpro/phi-2-role-play
Text Generation
•
Updated
•
19
ecastera/eva-mistral-7b-spanish-GGUF
7B
•
Updated
•
92
•
8
ProphetOfBostrom/opus-v1-34b-4b8h-8192l-EXL2
Text Generation
•
Updated
•
2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-4bit
Text Generation
•
4B
•
Updated
•
39
•
1