khtsly commited on
Commit
25a95ef
·
1 Parent(s): 9769bca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -6
README.md CHANGED
@@ -1,15 +1,34 @@
1
  ---
2
- base_model: khtsly/Mini-Coder-v2-noft
 
 
 
 
 
 
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
- - qwen3_5
8
- license: apache-2.0
9
- language:
10
- - en
 
 
 
 
 
 
 
11
  ---
12
 
 
 
 
 
 
 
13
  # Uploaded finetuned model
14
 
15
  - **Developed by:** khtsly
@@ -18,4 +37,4 @@ language:
18
 
19
  This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
+ license: apache-2.0
6
+ base_model:
7
+ - Qwen/Qwen3.5-9B
8
+ - Qwen/Qwen3.5-9B-Base
9
  tags:
10
  - text-generation-inference
11
  - transformers
12
  - unsloth
13
+ - qwen
14
+ - qwen3.5
15
+ - reasoning
16
+ - chain-of-thought
17
+ - lora
18
+ - luau
19
+ - roblox
20
+ pipeline_tag: image-text-to-text
21
+ datasets:
22
+ - khtsly/luau-stack-hq
23
+ - khtsly/luau-repo-docs-text
24
  ---
25
 
26
+ # Mini-Coder-v2 (15B)
27
+
28
+ Mini-Coder-v2 is build on top of upscaled Qwen3.5-9B model with Continual Pretraining (CPT), we feed ~34k high-quality curated luau raw codes to improves the luau coding tasks capability.
29
+
30
+ This model present a upscaled of Qwen3.5-9B from only 32 layers to 56 layers for a deeper reasoning capability! This model parameters is 15.07B with Vision, 14.60B without Vision.
31
+
32
  # Uploaded finetuned model
33
 
34
  - **Developed by:** khtsly
 
37
 
38
  This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
39
 
40
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)