turboderp
/

granite-3.1-8b-instruct-exl2

Model card Files Files and versions Community

granite-3.1-8b-instruct-exl2 / README.md

turboderp's picture

Update README.md

8a783a5 verified 7 months ago

|

history blame contribute delete

648 Bytes

metadata

license: apache-2.0

EXL2 quants of granite-3.1-8b-instruct

4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json