| language: | |
| - zh | |
| # Tiny BERT 4L zh | |
| This is a backup repo of [the official repo](https://huggingface.co/huawei-noah/TinyBERT_4L_zh). | |
| Now the model can be loaded with | |
| ```python | |
| from transformers import AutoModel | |
| model = AutoModel.from_pretrained("JeremiahZ/TinyBERT_4L_zh_backup") | |
| ``` | |
| More information on this model can be found [here](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TinyBERT). |