Update README.md
Browse files
README.md
CHANGED
@@ -119,7 +119,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
119 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
120 |
```
|
121 |
|
122 |
-
## int4wo-hqq
|
123 |
```
|
124 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
|
125 |
```
|
|
|
119 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
120 |
```
|
121 |
|
122 |
+
## int4 weight only quantization with hqq (int4wo-hqq)
|
123 |
```
|
124 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
|
125 |
```
|