Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mixtral-8x22B-v0.1-exl2

Model card Files Files and versions
xet
Community
2
Mixtral-8x22B-v0.1-exl2 / README.md
WaveCut's picture
WaveCut
typo
bc3049d verified over 1 year ago
preview code
|
raw
history blame
789 Bytes

EXL2 quants of Mixtral 8x22B v0.1

2.30 bits per weight
2.90 bits per weight
3.00 bits per weight
3.25 bits per weight
4.50 bits per weight
5.00 bits per weight

measurement.json