jerryzh168 commited on
Commit
8e3e54a
·
verified ·
1 Parent(s): 47aed6e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -119,7 +119,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
119
  lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
120
  ```
121
 
122
- ## int4wo-hqq
123
  ```
124
  lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
125
  ```
 
119
  lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
120
  ```
121
 
122
+ ## int4 weight only quantization with hqq (int4wo-hqq)
123
  ```
124
  lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
125
  ```