qqaatw's picture
Upload model and tokenizer
8a49cfd
metadata
language: en
license: apache-2.0

realm-cc-news-pretrained-embedder

Model description

The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language.

The original paper, code, and checkpoints can be found here.

Usage

from transformers import RealmEmbedder

embedder = RealmEmbedder.from_pretrained("qqaatw/realm-cc-news-pretrained-embedder")