OPEA
/

Llama-3.3-70B-Instruct-int2-sym-inc-preview

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 6 days ago

Commit

cc7adfa

•

1 Parent(s): 49da73c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -99,7 +99,7 @@ prompt = "Once upon a time,"
 pip3 install lm-eval==0.4.5
 ```bash
- auto-round --eval --model "OPEA/Llama-3.3-70B-Instruct-int4-sym-inc" --eval_bs 64  --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
 ```
 |           Metric           |           BF16           |      INT2G32      |

 pip3 install lm-eval==0.4.5
 ```bash
+ auto-round --eval --model "OPEA/Llama-3.3-70B-Instruct-int2-sym-inc-preview" --eval_bs 64  --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
 ```
 |           Metric           |           BF16           |      INT2G32      |