Update README.md
Browse filesupdate discord link https://discord.gg/cognitivecomputations
README.md
CHANGED
|
@@ -23,7 +23,7 @@ This is our most spectacular outcome ever. FFT, all parameters, 16bit. 77.4 MML
|
|
| 23 |
|
| 24 |
Although the max positional embeddings is 4k, we used rope theta of 1000000.0 and we trained with sequence length 8k. We plan to train on the upcoming 32k version as well.
|
| 25 |
|
| 26 |
-
Discord: https://discord.gg/
|
| 27 |
|
| 28 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
|
| 29 |
|
|
|
|
| 23 |
|
| 24 |
Although the max positional embeddings is 4k, we used rope theta of 1000000.0 and we trained with sequence length 8k. We plan to train on the upcoming 32k version as well.
|
| 25 |
|
| 26 |
+
Discord: https://discord.gg/cognitivecomputations
|
| 27 |
|
| 28 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
|
| 29 |
|