khtsly commited on
Commit
9e4ca3d
·
verified ·
1 Parent(s): d97e351

Unsloth Model Card

Browse files
Files changed (1) hide show
  1. README.md +4 -12
README.md CHANGED
@@ -1,29 +1,21 @@
1
  ---
2
- base_model: khtsly/Coder-9B
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
- - qwen3_5_text
8
  license: apache-2.0
9
  language:
10
  - en
11
  ---
12
 
13
- # Mini-Coder
14
-
15
- Mini-Coder is build on top of Qwen3.5-9B model with Continual Pretraining (CPT), we feed ~500k high-quality curated luau samples to improves the luau coding tasks capability.
16
-
17
- We also inject over 14k samples from open-source of claude 4.6 distillations with a fews additional samples for Supervised-Finetuning (SFT) to improves the model reasnoning, We also see the average consumed tokens has drastically reduced.
18
-
19
- It's fine-tuned efficiently using LoRA (16-bit) and rsLoRA with Rank (r) set to 64 and Alpha (α) set to 128, ensuring strong adaptation and retention of new complex logic, it were trained specifically to handle up to 32,768 (32k) tokens of maximum output (recommended).
20
-
21
  # Uploaded finetuned model
22
 
23
  - **Developed by:** khtsly
24
  - **License:** apache-2.0
25
- - **Finetuned from model :** khtsly/Coder-9B
26
 
27
- This qwen3_5_text model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
28
 
29
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
+ base_model: Qwen/Qwen3.5-9B
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
+ - qwen3_5
8
  license: apache-2.0
9
  language:
10
  - en
11
  ---
12
 
 
 
 
 
 
 
 
 
13
  # Uploaded finetuned model
14
 
15
  - **Developed by:** khtsly
16
  - **License:** apache-2.0
17
+ - **Finetuned from model :** Qwen/Qwen3.5-9B
18
 
19
+ This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)