Commit
•
d9be7c3
1
Parent(s):
0027074
Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,11 @@ context is maybe 16k?
|
|
| 25 |
|
| 26 |
Chat-instruct breaks the model at the moment, not really sure why, even tho it will follow instructions.
|
| 27 |
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
Update:
|
| 31 |
Next model (Lumosia v2) will have the the same MoE models but with a fully trained head and gates. Sould increase performance alot.
|
|
|
|
| 25 |
|
| 26 |
Chat-instruct breaks the model at the moment, not really sure why, even tho it will follow instructions.
|
| 27 |
|
| 28 |
+
Quants by @thebloke (thank you)
|
| 29 |
+
|
| 30 |
+
https://huggingface.co/TheBloke/Lumosia-MoE-4x10.7-GGUF
|
| 31 |
+
|
| 32 |
+
https://huggingface.co/TheBloke/Lumosia-MoE-4x10.7-GPTQ
|
| 33 |
|
| 34 |
Update:
|
| 35 |
Next model (Lumosia v2) will have the the same MoE models but with a fully trained head and gates. Sould increase performance alot.
|