Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mistral-Large-Instruct-2411-exl3

Model card Files Files and versions
xet
Community
2
Mistral-Large-Instruct-2411-exl3 / README.md
turboderp's picture
turboderp
Update README.md
1dd6bbd verified 5 months ago
preview code
|
raw
history blame contribute delete
1.51 kB
metadata
license: other
license_name: mrl

EXL3 quants of Mistral-Large-Instruct-2411

1.40 bits per weight / H4
1.60 bits per weight / H4
1.80 bits per weight / H5
2.00 bits per weight / H5
2.25 bits per weight / H5
2.50 bits per weight / H5
3.00 bits per weight / H6
3.50 bits per weight / H6
4.00 bits per weight / H6
5.00 bits per weight / H6
6.00 bits per weight / H6

image/png