EXL3 models
Collection
38 items
•
Updated
•
38
EXL3 quants of GLM-4.5V
⚠️ Requires ExLlamaV3 v0.0.15 (or v0.0.14 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
Optimized:
2.13 bits per weight
2.32 bits per weight
2.55 bits per weight
2.80 bits per weight
3.07 bits per weight
3.49 bits per weight
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support