QuantFactory/MadWizard-SFT-v2-Mistral-7b-v0.3-GGUF

This ia quantized version of Lumpen1/MadWizard-SFT-v2-Mistral-7b-v0.3 created using llama.cpp

Downloads last month
3
GGUF
Model size
7.25B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for QuantFactory/MadWizard-SFT-v2-Mistral-7b-v0.3-GGUF

Quantized
(3)
this model