Update README.md
Browse files
README.md
CHANGED
|
@@ -42,3 +42,5 @@ Keep an eye out for **V.2**, it's going to be a game-changer! And is currently t
|
|
| 42 |
- Thank you to the Hugging Face team, for everything.❤️ We really do appreciate you guys and all your hard work and commitment to the open source community!❤️
|
| 43 |
|
| 44 |
## I will answer more questions about this model tomorrow, I have not slept since mixtral 22bx8 dropped. Base model + V.2 Lora checkpoint will be available tomorrow ##
|
|
|
|
|
|
|
|
|
| 42 |
- Thank you to the Hugging Face team, for everything.❤️ We really do appreciate you guys and all your hard work and commitment to the open source community!❤️
|
| 43 |
|
| 44 |
## I will answer more questions about this model tomorrow, I have not slept since mixtral 22bx8 dropped. Base model + V.2 Lora checkpoint will be available tomorrow ##
|
| 45 |
+
|
| 46 |
+
## Future plans, potentially continued pretraning, if 1. more questions dosent help, or 2. My second idea to only use the knowledge from 2 experts as oppsed to all 8. Since compressing all 8 might lead to the DORI effect (yes from findng nemo).
|