Hugging Face's logo

turboderp
/
c4ai-command-r-08-2024-exl3

Model card Files Community
1
turboderp commited on
Commit
2023695
·
verified ·
1 Parent(s): 5ef814a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ ---
4
+
5
+ EXL3 quants of [C4AI Command R 08-2024](https://huggingface.co/CohereLabs/c4ai-command-r-08-2024)
6
+
7
+ [2.00 bits per weight](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/2.0bpw)
8
+ [2.50 bits per weight](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/2.5bpw)
9
+ [3.00 bits per weight](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/3.0bpw)
10
+ [4.00 bits per weight](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/4.0bpw)
11
+ [6.00 bits per weight](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/6.0bpw)
12
+ [8.00 bits per weight / H8](https://huggingface.co/turboderp/c4ai-command-r-08-2024-exl3/tree/8.0bpw_H8)