File size: 284 Bytes
7fa5c18
 
 
4e87b96
 
 
 
1
2
3
4
5
6
7
---
license: gpl-3.0
---

2expert 39layer experimental MoE for multilingual performance. 

Don't use this in production because it will very very soon get replaced , it's merely here for the benchmarks and it's actually bad at multilingual performance compared to previous experiment.