system HF staff commited on
Commit
b01b989
1 Parent(s): c9a11fc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -5,6 +5,8 @@ Google Research's [ELECTRA](https://github.com/google-research/electra).
5
 
6
  Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
7
 
 
 
8
  ## Corpus
9
 
10
  Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)
 
5
 
6
  Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
7
 
8
+ Current V1 is at 120,000 steps
9
+
10
  ## Corpus
11
 
12
  Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)