Hugging Face's logo

Intel
/
Phi-3-mini-128k-instruct-int4-inc

English
Model card Files Community
yintongl commited on
Commit
ce595cf
•
1 Parent(s): 3faabd8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -53,7 +53,7 @@ Install [lm-eval-harness 0.4.2](https://github.com/EleutherAI/lm-evaluation-harn
53
  lm_eval --model hf --model_args pretrained="Intel/Phi-3-mini-128k-instruct-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu --batch_size 32
54
  ```
55
 
56
- | Metric | BF16 | INT4 |
57
  | -------------- | ------ | ------ |
58
  | Avg. | 0.6364 | 0.6300 |
59
  | mmlu | 0.6215 | 0.6237 |
 
53
  lm_eval --model hf --model_args pretrained="Intel/Phi-3-mini-128k-instruct-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu --batch_size 32
54
  ```
55
 
56
+ | Metric | FP16 | INT4 |
57
  | -------------- | ------ | ------ |
58
  | Avg. | 0.6364 | 0.6300 |
59
  | mmlu | 0.6215 | 0.6237 |