CompactAI commited on
Commit
1f1306f
Β·
verified Β·
1 Parent(s): d3d96d3

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -27,18 +27,18 @@ This model is a **aggressively pruned** version of [Qwen/Qwen2.5-3B-Instruct](ht
27
 
28
  | Category | Original | Pruned | Change |
29
  |----------|----------|--------|--------|
30
- | **Python** | 100.0% | 40.0% ⭐ | ↓ 60.0% |
31
  | Html | 6.7% | 0.0% | ↓ 6.7% |
32
- | Trivia | 66.7% | 60.0% | ↓ 6.7% |
33
- | Math | 60.0% | 66.7% | ↑ 6.7% |
34
- | Reasoning | 100.0% | 86.7% | ↓ 13.3% |
35
- | Medical | 86.7% | 80.0% | ↓ 6.7% |
36
- | Linux | 100.0% | 100.0% | β†’ |
37
- | Writing | 73.3% | 73.3% | β†’ |
38
 
39
- **Average**: 74.2% β†’ 63.3% (-10.8%)
40
 
41
- **Python Retention**: 40.0% of original performance
42
 
43
  ![Comparison Graph](comparison_graph.png)
44
 
 
27
 
28
  | Category | Original | Pruned | Change |
29
  |----------|----------|--------|--------|
30
+ | **Python** | 40.0% | 13.3% ⭐ | ↓ 26.7% |
31
  | Html | 6.7% | 0.0% | ↓ 6.7% |
32
+ | Trivia | 88.9% | 73.3% | ↓ 15.6% |
33
+ | Math | 57.8% | 62.2% | ↑ 4.4% |
34
+ | Reasoning | 33.3% | 28.9% | ↓ 4.4% |
35
+ | Medical | 93.3% | 84.4% | ↓ 8.9% |
36
+ | Linux | 95.6% | 93.3% | ↓ 2.2% |
37
+ | Writing | 62.2% | 60.0% | ↓ 2.2% |
38
 
39
+ **Average**: 59.7% β†’ 51.9% (-7.8%)
40
 
41
+ **Python Retention**: 33.3% of original performance
42
 
43
  ![Comparison Graph](comparison_graph.png)
44
 
comparison_graph.png CHANGED
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c32815103a55a91a5a9aaab5031ab4617fe45d38948ee2ba0e0e64a5ffe6336d
3
  size 3995916600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3053d788c32f12320275840c58dd6893508dda79b6ae02d90eb1bfbfa1c29393
3
  size 3995916600
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:726f87d51e70d642a1ef788b0659139104b53042a29d4968ae703ed35499b284
3
  size 2176009944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3e7bf62f1bb6cfb8dcaef62af3bfcbc739ea854e47f2955093ce867f12a2634
3
  size 2176009944