CompactAI commited on
Commit
028ea45
·
verified ·
1 Parent(s): 82efaf1

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. README.md +18 -37
  2. comparison_graph.png +0 -0
  3. model.safetensors +1 -1
  4. tokenizer.json +1 -1
README.md CHANGED
@@ -5,44 +5,36 @@ tags:
5
  - python
6
  - optimized
7
  - wanda
8
- - activation-pruning
9
  base_model: LGAI-EXAONE/EXAONE-4.0-1.2B
10
  pipeline_tag: text-generation
11
  ---
12
 
13
  # EXAONE-4.0-1.2B-python-aggressive
14
 
15
- > 🎯 **PYTHON-optimized** | 📦 **Aggressive** pruning | ⚡ **7% weights pruned**
16
 
17
- This model is a **aggressively pruned** version of [LGAI-EXAONE/EXAONE-4.0-1.2B](https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-1.2B), specialized for **PYTHON** tasks using activation-aware weight pruning (Wanda-style).
18
 
19
- ## Key Features
20
-
21
- - **Specialization**: Optimized for Python tasks
22
- - **Pruning Method**: Wanda-style (|W| × |activation|) importance scoring
23
- - **Size Reduction**: 7% weights pruned
24
- - **Use Case**: Maximum compression for edge deployment
25
-
26
- ## 📊 Performance Comparison
27
 
28
  | Category | Original | Pruned | Change |
29
  |----------|----------|--------|--------|
30
- | **Python** | 20.0% | 20.0% ⭐ | |
31
- | Html | 6.7% | 6.7% | |
32
- | Trivia | 26.7% | 53.3% | 26.7% |
33
- | Math | 60.0% | 53.3% | 6.7% |
34
- | Reasoning | 60.0% | 73.3% | 13.3% |
35
- | Medical | 73.3% | 80.0% | 6.7% |
36
- | Linux | 93.3% | 93.3% | → |
37
- | Writing | 60.0% | 53.3% | ↓ 6.7% |
38
 
39
- **Average**: 50.0% → 54.2% (+4.2%)
40
 
41
- **Python Retention**: 100.0% of original performance
42
 
43
  ![Comparison Graph](comparison_graph.png)
44
 
45
- ## 🚀 Quick Start
46
 
47
  ```python
48
  from transformers import AutoModelForCausalLM, AutoTokenizer
@@ -50,31 +42,20 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
50
  model = AutoModelForCausalLM.from_pretrained("CompactAI/EXAONE-4.0-1.2B-python-aggressive")
51
  tokenizer = AutoTokenizer.from_pretrained("CompactAI/EXAONE-4.0-1.2B-python-aggressive")
52
 
53
- # Example usage
54
  inputs = tokenizer("Your prompt here", return_tensors="pt")
55
  outputs = model.generate(**inputs, max_new_tokens=100)
56
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
57
  ```
58
 
59
- ## 📋 Technical Details
60
 
61
  | Property | Value |
62
  |----------|-------|
63
  | Base Model | [LGAI-EXAONE/EXAONE-4.0-1.2B](https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-1.2B) |
64
  | Specialization | Python |
65
  | Prune Mode | Aggressive |
66
- | Pruning Method | Activation-based weight pruning (Wanda) |
67
- | Weight Reduction | 7% weights pruned |
68
-
69
- ## 🔗 Related Models
70
 
71
- This model is part of the **EXAONE-4.0-1.2B** pruned model collection. Variants:
72
- - **Safe** - Conservative pruning (~10-20%), high accuracy retention
73
- - **Aggressive** - Maximum compression (~40-50%), best for edge deployment
74
 
75
- ## 📜 License
76
-
77
- This model inherits the license from the base model [LGAI-EXAONE/EXAONE-4.0-1.2B](https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-1.2B).
78
-
79
- ---
80
- *Generated by ZANNPS [Zeto Automatic Neural Network Pruning System]*
 
5
  - python
6
  - optimized
7
  - wanda
 
8
  base_model: LGAI-EXAONE/EXAONE-4.0-1.2B
9
  pipeline_tag: text-generation
10
  ---
11
 
12
  # EXAONE-4.0-1.2B-python-aggressive
13
 
14
+ > 🎯 **PYTHON-optimized** | 📦 **Aggressive** pruning | ⚡ **30% weights pruned**
15
 
16
+ This model is a **aggressively pruned** version of [LGAI-EXAONE/EXAONE-4.0-1.2B](https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-1.2B).
17
 
18
+ ## Performance Comparison
 
 
 
 
 
 
 
19
 
20
  | Category | Original | Pruned | Change |
21
  |----------|----------|--------|--------|
22
+ | **Python** | 76.9% | 61.5% ⭐ | 15.4% |
23
+ | Html | 20.0% | 10.0% | 10.0% |
24
+ | Trivia | 86.7% | 53.3% | 33.3% |
25
+ | Math | 80.0% | 93.3% | 13.3% |
26
+ | Reasoning | 75.0% | 50.0% | 25.0% |
27
+ | Medical | 42.9% | 14.3% | 28.6% |
28
+ | Linux | 23.1% | 23.1% | → |
29
+ | Writing | 54.5% | 0.0% | ↓ 54.5% |
30
 
31
+ **Average**: 57.4% → 38.2% (-19.2%)
32
 
33
+ **Python Retention**: 80.0%
34
 
35
  ![Comparison Graph](comparison_graph.png)
36
 
37
+ ## Quick Start
38
 
39
  ```python
40
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
42
  model = AutoModelForCausalLM.from_pretrained("CompactAI/EXAONE-4.0-1.2B-python-aggressive")
43
  tokenizer = AutoTokenizer.from_pretrained("CompactAI/EXAONE-4.0-1.2B-python-aggressive")
44
 
 
45
  inputs = tokenizer("Your prompt here", return_tensors="pt")
46
  outputs = model.generate(**inputs, max_new_tokens=100)
47
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
48
  ```
49
 
50
+ ## Technical Details
51
 
52
  | Property | Value |
53
  |----------|-------|
54
  | Base Model | [LGAI-EXAONE/EXAONE-4.0-1.2B](https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-1.2B) |
55
  | Specialization | Python |
56
  | Prune Mode | Aggressive |
57
+ | Weight Reduction | 30% weights pruned |
 
 
 
58
 
59
+ ## License
 
 
60
 
61
+ This model inherits the license from the base model.
 
 
 
 
 
comparison_graph.png CHANGED
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:feca229ba9acdac8b8075ead8c7c7f04862c3ca4e1477663ac287377d35dc46c
3
  size 2558820960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c72a92b33c4db88f0addee7b4f1e9834012f6f341f038b04a7c0504c7601923e
3
  size 2558820960
tokenizer.json CHANGED
@@ -2,7 +2,7 @@
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
- "max_length": 64512,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
 
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
+ "max_length": 65386,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },