LH-Tech-AI commited on
Commit
8bfb242
·
verified ·
1 Parent(s): 859492a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -25,10 +25,13 @@ The models in the LH-Tech AI Pin Series are very small models that were trained
25
  | Pin-10M | 10.06M | 1500 | 2.562048 | Very Poor | That sounds nice, I agree, it is nice to talk about new ideas. |
26
  | Pin-15M | 14.84M | 1500 | 2.358367 | Low | It is hard to see your plans when you want to enjoy the day. |
27
  | Pin-20M | 21.03M | 1500 | 2.217588 | Medium | Yes, sunny days are wonderful! I love hearing about the sunshine and the sun's shining on. |
28
- | Pin-25M | 26.76M | 1500 | 2.XXXXXX | | XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX |
 
29
 
30
  \* All models were prompted with `What is the weather like today?`.
31
 
 
 
32
  ## Training
33
  ### Training data
34
  We trained on [starhopp3r/TinyChat](https://huggingface.co/datasets/starhopp3r/TinyChat) and used the gpt-2 tokenizer.
@@ -43,6 +46,7 @@ You can find the full training code for the Pin Model Series in this repo.<br>
43
  | **Pin-15M** | *8* | *8* | *208* | *832* |
44
  | **Pin-20M** | *10* | *8* | *256* | *1024* |
45
  | **Pin-25M** | *12* | *12* | *288* | *1152* |
 
46
 
47
  Have fun :D
48
 
 
25
  | Pin-10M | 10.06M | 1500 | 2.562048 | Very Poor | That sounds nice, I agree, it is nice to talk about new ideas. |
26
  | Pin-15M | 14.84M | 1500 | 2.358367 | Low | It is hard to see your plans when you want to enjoy the day. |
27
  | Pin-20M | 21.03M | 1500 | 2.217588 | Medium | Yes, sunny days are wonderful! I love hearing about the sunshine and the sun's shining on. |
28
+ | Pin-25M | 26.76M | 1500 | 2.XXXXXX | XXXXXX | XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX |
29
+ | Pin-Ultra-25M | 26.76M | 8000 | ... | ... | Coming soon... |
30
 
31
  \* All models were prompted with `What is the weather like today?`.
32
 
33
+ 🚀 **We recommend using Pin-Ultra-25M.**
34
+
35
  ## Training
36
  ### Training data
37
  We trained on [starhopp3r/TinyChat](https://huggingface.co/datasets/starhopp3r/TinyChat) and used the gpt-2 tokenizer.
 
46
  | **Pin-15M** | *8* | *8* | *208* | *832* |
47
  | **Pin-20M** | *10* | *8* | *256* | *1024* |
48
  | **Pin-25M** | *12* | *12* | *288* | *1152* |
49
+ | **Pin-Ultra-25M** | *12* | *12* | *288* | *1152* |
50
 
51
  Have fun :D
52