Upload folder using huggingface_hub

README.md

@@ -0,0 +1,61 @@
+---
+license: apache-2.0
+tags:
+- pruned
+- python
+- optimized
+- wanda
+base_model: raincandy-u/Rain-100M
+pipeline_tag: text-generation
+---
+
+# Rain-100M-python-aggressive
+
+> 🎯 **PYTHON-optimized** | 📦 **Aggressive** pruning | ⚡ **1% weights pruned**
+
+This model is a **aggressively pruned** version of [raincandy-u/Rain-100M](https://huggingface.co/raincandy-u/Rain-100M).
+
+## Performance Comparison
+
+| Category | Original | Pruned | Change |
+|----------|----------|--------|--------|
+| **Python** | 0.0% | 0.0% ⭐ | → |
+| Html | 0.0% | 0.0% | → |
+| Trivia | 0.0% | 0.0% | → |
+| Math | 0.0% | 0.0% | → |
+| Reasoning | 0.0% | 0.0% | → |
+| Medical | 0.0% | 0.0% | → |
+| Linux | 0.0% | 0.0% | → |
+| Writing | 0.0% | 0.0% | → |
+
+**Average**: 0.0% → 0.0% (+0.0%)
+
+
+
+![Comparison Graph](comparison_graph.png)
+
+## Quick Start
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model = AutoModelForCausalLM.from_pretrained("CompactAI/Rain-100M-python-aggressive")
+tokenizer = AutoTokenizer.from_pretrained("CompactAI/Rain-100M-python-aggressive")
+
+inputs = tokenizer("Your prompt here", return_tensors="pt")
+outputs = model.generate(**inputs, max_new_tokens=100)
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
+
+## Technical Details
+
+| Property | Value |
+|----------|-------|
+| Base Model | [raincandy-u/Rain-100M](https://huggingface.co/raincandy-u/Rain-100M) |
+| Specialization | Python |
+| Prune Mode | Aggressive |
+| Weight Reduction | 1% weights pruned |
+
+## License
+
+This model inherits the license from the base model.

config.json

@@ -0,0 +1,47 @@
+{
+  "architectures": [
+    "Qwen3ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 2,
+  "dtype": "float16",
+  "eos_token_id": 3,
+  "head_dim": 64,
+  "hidden_act": "silu",
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 2048,
+  "layer_types": [
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention"
+  ],
+  "max_position_embeddings": 4096,
+  "max_window_layers": 28,
+  "model_type": "qwen3",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "num_key_value_heads": 12,
+  "pad_token_id": 0,
+  "rms_norm_eps": 1e-06,
+  "rope_parameters": {
+    "rope_theta": 10000.0,
+    "rope_type": "default"
+  },
+  "sliding_window": null,
+  "tie_word_embeddings": true,
+  "transformers_version": "5.0.0",
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 16000
+}

generation_config.json

@@ -0,0 +1,8 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 2,
+  "do_sample": false,
+  "eos_token_id": 3,
+  "pad_token_id": 0,
+  "transformers_version": "5.0.0"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bff26add0033d2924bb271644cc0b72a02e5492248547beab18ba09dd1d6aa5
+size 194501472

tokenizer_config.json

@@ -0,0 +1,12 @@
+{
+  "backend": "tokenizers",
+  "bos_token": "[BOS]",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "[EOS]",
+  "is_local": false,
+  "model_max_length": 4096,
+  "model_specific_special_tokens": {},
+  "pad_token": "[PAD]",
+  "tokenizer_class": "TokenizersBackend",
+  "unk_token": "[UNK]"
+}