Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ tags:
|
|
| 7 |
|
| 8 |
## Exllama v2 Quantization of Mistral-7B-codealpaca-lora
|
| 9 |
|
|
|
|
|
|
|
| 10 |
Conversion done using evol-codealpaca-v1.parquet as calibration dataset.
|
| 11 |
|
| 12 |
Original model: https://huggingface.co/Nondzu/Mistral-7B-codealpaca-lora
|
|
|
|
| 7 |
|
| 8 |
## Exllama v2 Quantization of Mistral-7B-codealpaca-lora
|
| 9 |
|
| 10 |
+
Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.6">turboderp's ExLlamaV2 v0.0.6</a> for quantization.
|
| 11 |
+
|
| 12 |
Conversion done using evol-codealpaca-v1.parquet as calibration dataset.
|
| 13 |
|
| 14 |
Original model: https://huggingface.co/Nondzu/Mistral-7B-codealpaca-lora
|