kmfoda commited on
Commit
92c1f90
·
verified ·
1 Parent(s): abf7537

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags: [chat-model-competition, bittensor, llama, from-scratch]
3
+ license: apache-2.0
4
+ ---
5
+ # test-llama-tiny
6
+ Chat model trained with the Chat Model Competition Bittensor subnet.
7
+
8
+ **Architecture:** LlamaForCausalLM (vLLM compatible)
9
+
10
+ **Pipeline:** Pretrain (100 steps) → SFT (50 steps) → RL/GRPO (20 steps)
11
+
12
+ | Property | Value |
13
+ |----------|-------|
14
+ | Parameters | 13.3M |
15
+ | Architecture | 2L / 4H / 2KV / 128D |
16
+ | Intermediate | 384 |
17
+ | Seq Length | 128 |