wenhuach commited on
Commit
7ae908f
1 Parent(s): 3dd4a87

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -55,9 +55,9 @@ print(tokenizer.decode(model.generate(**tokenizer("There is a girl who likes adv
55
 
56
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id f3b7917091afba325af3980a35d8a6dcba03dc3f
57
 
58
- ~~bash
59
  lm_eval --model hf --model_args pretrained="Intel/Mistral-7B-v0.1-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,rte,arc_easy,arc_challenge,mmlu --batch_size 128
60
- ~~
61
 
62
  | Metric | FP16 | INT4 |
63
  | -------------- | ------ | ------ |
 
55
 
56
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id f3b7917091afba325af3980a35d8a6dcba03dc3f
57
 
58
+ ```bash
59
  lm_eval --model hf --model_args pretrained="Intel/Mistral-7B-v0.1-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,rte,arc_easy,arc_challenge,mmlu --batch_size 128
60
+ ```
61
 
62
  | Metric | FP16 | INT4 |
63
  | -------------- | ------ | ------ |