Intel
/

gemma-7b-int4-inc

Model card Files Files and versions Community

yintongl commited on May 21

Commit

7e5f479

•

1 Parent(s): ee3373c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ Install [lm-eval-harness 0.4.2](https://github.com/EleutherAI/lm-evaluation-harn
 lm_eval --model hf --model_args pretrained="Intel/gemma-7b-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,rte,arc_easy,arc_challenge,mmlu --batch_size 32
 ```
-| Metric         | BF16   | int4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.6302 | 0.6262 |
 | mmlu           | 0.6199 | 0.6111 |

 lm_eval --model hf --model_args pretrained="Intel/gemma-7b-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,rte,arc_easy,arc_challenge,mmlu --batch_size 32
 ```
+| Metric         | FP16   | int4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.6302 | 0.6262 |
 | mmlu           | 0.6199 | 0.6111 |