Update README.md
Browse files
README.md
CHANGED
|
@@ -23,6 +23,22 @@ model-index:
|
|
| 23 |
|
| 24 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
## Model Details
|
| 27 |
|
| 28 |
### Model Description
|
|
|
|
| 23 |
|
| 24 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
| 25 |
|
| 26 |
+
# Quantizationed versions
|
| 27 |
+
|
| 28 |
+
Quantizationed versions of this model are available thanks to [TheBloke](https://hf.co/TheBloke).
|
| 29 |
+
|
| 30 |
+
##### GPTQ
|
| 31 |
+
|
| 32 |
+
- [TheBloke/vicuna-33B-coder-GPTQ](https://huggingface.co/TheBloke/vicuna-33B-coder-GPTQ)
|
| 33 |
+
|
| 34 |
+
##### GGUF
|
| 35 |
+
|
| 36 |
+
- [TheBloke/vicuna-33B-coder-GGUF](https://huggingface.co/TheBloke/vicuna-33B-coder-GGUF)
|
| 37 |
+
|
| 38 |
+
##### AWQ
|
| 39 |
+
|
| 40 |
+
- [TheBloke/vicuna-33B-coder-AWQ](https://huggingface.co/TheBloke/vicuna-33B-coder-AWQ)
|
| 41 |
+
|
| 42 |
## Model Details
|
| 43 |
|
| 44 |
### Model Description
|