File size: 296 Bytes
8c1ea89 1721e5e 8c1ea89 1721e5e f7e1fcf |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
datasets:
- wikipedia
---
# Model details
`minimoe-4L-384H` distilled from `bert-base-uncased` on `Wikipedia`.
Repository: [https://github.com/GeneZC/MiniMoE](https://github.com/GeneZC/MiniMoE)
arXiv: [https://arxiv.org/abs/2305.12129](https://arxiv.org/abs/2305.12129) |