| language: en | |
| license: apache-2.0 | |
| # realm-cc-news-pretrained-embedder | |
| ## Model description | |
| The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language. | |
| The original paper, code, and checkpoints can be found [here](https://github.com/google-research/language/tree/master/language/realm). | |
| ## Usage | |
| ```python | |
| from transformers import RealmEmbedder | |
| embedder = RealmEmbedder.from_pretrained("qqaatw/realm-cc-news-pretrained-embedder") | |
| ``` | |