Spaces:
Sleeping
Sleeping
Matrix
commited on
Update app.py
Browse files
app.py
CHANGED
|
@@ -240,6 +240,11 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
|
|
| 240 |
## ✅ Quantized Models Download List
|
| 241 |
|
| 242 |
### 🔍 Recommended Quantizations
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 243 |
| 🚀 Download | 🔢 Type | 📝 Notes |
|
| 244 |
|:---------|:-----|:------|
|
| 245 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|
|
|
|
| 240 |
## ✅ Quantized Models Download List
|
| 241 |
|
| 242 |
### 🔍 Recommended Quantizations
|
| 243 |
+
- **✨ General CPU Use:** [`Q4_K_M`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_k_m.gguf) (Best balance of speed/quality)
|
| 244 |
+
- **📱 ARM Devices:** [`Q4_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_0.gguf) (Optimized for ARM CPUs)
|
| 245 |
+
- **🏆 Maximum Quality:** [`Q8_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q8_0.gguf) (Near-original quality)
|
| 246 |
+
|
| 247 |
+
### 📦 Full Quantization Options
|
| 248 |
| 🚀 Download | 🔢 Type | 📝 Notes |
|
| 249 |
|:---------|:-----|:------|
|
| 250 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|