GeneZC
/

bert-base-minimoe-3L-384H

Model card Files Files and versions

bert-base-minimoe-3L-384H / README.md

GeneZC's picture

Update README.md

779ee87 over 3 years ago

|

History Blame Contribute Delete

296 Bytes

license: apache-2.0
datasets:
  - wikipedia

Model details

minimoe-3L-384H distilled from bert-base-uncased on Wikipedia.

repository: https://github.com/GeneZC/MiniMoE arXiv: https://arxiv.org/abs/2305.12129