Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
GeneZC
/
bert-base-minimoe-3L-384H
like
1
Transformers
PyTorch
wikipedia
bert
Inference Endpoints
arxiv:
2305.12129
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
GeneZC
commited on
May 30, 2023
Commit
8c21f1c
•
1 Parent(s):
7a6271e
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+6
-0
README.md
CHANGED
Viewed
@@ -1,3 +1,9 @@
1
---
2
license: apache-2.0
3
---
1
---
2
license: apache-2.0
3
+
datasets:
4
+
- wikipedia
5
---
6
+
7
+
# Model details
8
+
9
+
`minimoe-3L-384H` distilled from `bert-base-uncased` on `Wikipedia`.