Xuehao commited on
Commit
1569f13
·
verified ·
1 Parent(s): 1b3f32a

Update evaluate results

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -2,6 +2,7 @@
2
  base_model:
3
  - Qwen/Qwen3-Next-80B-A3B-Instruct
4
  pipeline_tag: text-generation
 
5
  ---
6
 
7
  ## Model Details
@@ -78,6 +79,12 @@ autoround.quantize_and_save(format="auto_round", output_dir="tmp_autoround")
78
 
79
  ```
80
 
 
 
 
 
 
 
81
 
82
  ## Ethical Considerations and Limitations
83
 
@@ -91,7 +98,7 @@ Users (both direct and downstream) should be made aware of the risks, biases and
91
 
92
  Here are a couple of useful links to learn more about Intel's AI software:
93
 
94
- - Intel Neural Compressor [link](https://github.com/intel/neural-compressor)
95
 
96
  ## Disclaimer
97
 
 
2
  base_model:
3
  - Qwen/Qwen3-Next-80B-A3B-Instruct
4
  pipeline_tag: text-generation
5
+ license: apache-2.0
6
  ---
7
 
8
  ## Model Details
 
79
 
80
  ```
81
 
82
+ ## Evaluate Results
83
+
84
+ | benchmark | n-shot | backend | Intel/Qwen3-Next-80B-A3B-Instruct-int4-mixed-AutoRound | Qwen/Qwen3-Next-80B-A3B-Instruct |
85
+ | :-------: | :----: | :-----: | :----------------------------------------------------: | :------------------------------: |
86
+ | gsm8k | 5 | vllm | 0.8393 | 0.8074 |
87
+ | mmlu_pro | 5 | vllm | 0.7630 | 0.7621 |
88
 
89
  ## Ethical Considerations and Limitations
90
 
 
98
 
99
  Here are a couple of useful links to learn more about Intel's AI software:
100
 
101
+ - [Intel Neural Compressor](https://github.com/intel/neural-compressor)
102
 
103
  ## Disclaimer
104