File size: 485 Bytes
fd18d25 5c79f7b fd18d25 |
1 2 3 4 5 6 7 8 9 10 |
---
license: mit
license_link: https://huggingface.co/rednote-hilab/dots.llm1.inst/blob/main/LICENSE
---
EXL3 quants of [dots.llms1.inst](https://huggingface.co/rednote-hilab/dots.llm1.inst)
[2.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.0bpw)
[2.50 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.5bpw)
[4.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/4.0bpw)
(more to come) |