Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
deepseek-llm-67B-chat-exl2

Model card Files Files and versions Community
deepseek-llm-67B-chat-exl2 / README.md
turboderp's picture
turboderp
Update README.md
2d44fdc over 1 year ago
preview code
|
raw
history blame contribute delete
918 Bytes

EXL2 quants of deepseek-llm-67B-chat

2.50 bits per weight (unstable)
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
6.00 bits per weight

measurement.json