Vykyan/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-ao-int4wo-gs128
Updated
•
4
Edit Models filters
Apps
Inference Providers
Active filters:
torchao
jcaip/fp8fnuz-opt-125m
Text Generation
•
Updated
•
4
appy1234/Phi-4-mini-instruct-float8dq
Text Generation
•
Updated
•
4
poinka/gemma-3-4b-pt-q8bits
Updated
•
8
kexve/DeepSeek-R1-Distill-Qwen-1.5B-torchao-int8_weight_only
Updated
•
3
vkuzometa/fp8-opt-125m
Text Generation
•
Updated
•
4
Bbboris1234/Phi-4-int4wo-hqq
Text Generation
•
Updated
•
3
jerryzh168/Phi-4-mini-instruct-int4wo-awq
Text Generation
•
Updated
•
164
jerryzh168/Qwen3-4B-unsloth-fp8
Text Generation
•
Updated
•
6
torchao-testing/opt-125m-float8dq-row-0.13-dev
Text Generation
•
Updated
•
32
torchao-testing/opt-125m-int4wo-preshuffled-0.13-dev
Text Generation
•
Updated
•
24
AINovice2005/quantized-SmolLM3-3B
Text Generation
•
Updated
•
45
•
1
AINovice2005/quantized-Phi-4-reasoning
Text Generation
•
Updated
•
10
AINovice2005/quantized-GLM-4.1V-9B-Thinking
Image-Text-to-Text
•
Updated
•
98
AINovice2005/quantized-SmolVLM2-2.2B-Base
Image-Text-to-Text
•
Updated
•
8
seba/Qwen3-0.6B-Int8
Text Generation
•
Updated
•
5
jerryzh168/Phi-4-mini-instruct-int4wo-preshuffled
Text Generation
•
Updated
•
13
jerryzh168/Phi-4-mini-instruct-int4wo
Text Generation
•
Updated
•
25
jerryzh168/Qwen3-8B-int4wo
Text Generation
•
Updated
•
15
jtl11/reranker-int4-cpu
Updated
•
25
mibrdeniz/turkish-gpt2-medium-350m-instruct-q8
Text Generation
•
Updated
•
8
mibrdeniz/turkish-gpt2-medium-350m-instruct-q4
Text Generation
•
Updated
•
6
jerryzh168/opt-125m-float8dq-row-0.13-dev
Text Generation
•
Updated
•
39
torchao-testing/Phi-4-mini-instruct-int4wo-awq-0.13-dev
Text Generation
•
Updated
•
39
torchao-testing/opt-125m-float8dq-row-v1-0.13-dev
Text Generation
•
Updated
•
85
torchao-testing/Qwen3-4B-int4wo-awq-0.13-dev
Text Generation
•
Updated
•
14