File size: 297 Bytes
dded39a 5b92169 dded39a 5b92169 996b946 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
datasets:
- wikipedia
---
# Model details
`minimoe-4L-384H` distilled from `bert-large-uncased` on `Wikipedia`.
repository: [https://github.com/GeneZC/MiniMoE](https://github.com/GeneZC/MiniMoE)
arXiv: [https://arxiv.org/abs/2305.12129](https://arxiv.org/abs/2305.12129) |