julien-c HF staff commited on
Commit
3275639
1 Parent(s): 41d3d3e

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/google/mobilebert-uncased/README.md

Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ thumbnail: https://huggingface.co/front/thumbnails/google.png
4
+
5
+ license: apache-2.0
6
+ ---
7
+
8
+ ## MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
9
+
10
+ MobileBERT is a thin version of BERT_LARGE, while equipped with bottleneck structures and a carefully designed balance
11
+ between self-attentions and feed-forward networks.
12
+
13
+ This checkpoint is the original MobileBert Optimized Uncased English:
14
+ [uncased_L-24_H-128_B-512_A-4_F-4_OPT](https://storage.googleapis.com/cloud-tpu-checkpoints/mobilebert/uncased_L-24_H-128_B-512_A-4_F-4_OPT.tar.gz)
15
+ checkpoint.
16
+
17
+ ## How to use MobileBERT in `transformers`
18
+
19
+ ```python
20
+ from transformers import pipeline
21
+
22
+ fill_mask = pipeline(
23
+ "fill-mask",
24
+ model="google/mobilebert-uncased",
25
+ tokenizer="google/mobilebert-uncased"
26
+ )
27
+
28
+ print(
29
+ fill_mask(f"HuggingFace is creating a {fill_mask.tokenizer.mask_token} that the community uses to solve NLP tasks.")
30
+ )
31
+
32
+ ```