Update README.md
Browse files
README.md
CHANGED
|
@@ -25,10 +25,13 @@ The models in the LH-Tech AI Pin Series are very small models that were trained
|
|
| 25 |
| Pin-10M | 10.06M | 1500 | 2.562048 | Very Poor | That sounds nice, I agree, it is nice to talk about new ideas. |
|
| 26 |
| Pin-15M | 14.84M | 1500 | 2.358367 | Low | It is hard to see your plans when you want to enjoy the day. |
|
| 27 |
| Pin-20M | 21.03M | 1500 | 2.217588 | Medium | Yes, sunny days are wonderful! I love hearing about the sunshine and the sun's shining on. |
|
| 28 |
-
| Pin-25M | 26.76M | 1500 | 2.XXXXXX |
|
|
|
|
| 29 |
|
| 30 |
\* All models were prompted with `What is the weather like today?`.
|
| 31 |
|
|
|
|
|
|
|
| 32 |
## Training
|
| 33 |
### Training data
|
| 34 |
We trained on [starhopp3r/TinyChat](https://huggingface.co/datasets/starhopp3r/TinyChat) and used the gpt-2 tokenizer.
|
|
@@ -43,6 +46,7 @@ You can find the full training code for the Pin Model Series in this repo.<br>
|
|
| 43 |
| **Pin-15M** | *8* | *8* | *208* | *832* |
|
| 44 |
| **Pin-20M** | *10* | *8* | *256* | *1024* |
|
| 45 |
| **Pin-25M** | *12* | *12* | *288* | *1152* |
|
|
|
|
| 46 |
|
| 47 |
Have fun :D
|
| 48 |
|
|
|
|
| 25 |
| Pin-10M | 10.06M | 1500 | 2.562048 | Very Poor | That sounds nice, I agree, it is nice to talk about new ideas. |
|
| 26 |
| Pin-15M | 14.84M | 1500 | 2.358367 | Low | It is hard to see your plans when you want to enjoy the day. |
|
| 27 |
| Pin-20M | 21.03M | 1500 | 2.217588 | Medium | Yes, sunny days are wonderful! I love hearing about the sunshine and the sun's shining on. |
|
| 28 |
+
| Pin-25M | 26.76M | 1500 | 2.XXXXXX | XXXXXX | XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX |
|
| 29 |
+
| Pin-Ultra-25M | 26.76M | 8000 | ... | ... | Coming soon... |
|
| 30 |
|
| 31 |
\* All models were prompted with `What is the weather like today?`.
|
| 32 |
|
| 33 |
+
🚀 **We recommend using Pin-Ultra-25M.**
|
| 34 |
+
|
| 35 |
## Training
|
| 36 |
### Training data
|
| 37 |
We trained on [starhopp3r/TinyChat](https://huggingface.co/datasets/starhopp3r/TinyChat) and used the gpt-2 tokenizer.
|
|
|
|
| 46 |
| **Pin-15M** | *8* | *8* | *208* | *832* |
|
| 47 |
| **Pin-20M** | *10* | *8* | *256* | *1024* |
|
| 48 |
| **Pin-25M** | *12* | *12* | *288* | *1152* |
|
| 49 |
+
| **Pin-Ultra-25M** | *12* | *12* | *288* | *1152* |
|
| 50 |
|
| 51 |
Have fun :D
|
| 52 |
|