kurumuz commited on
Commit
f8ecb92
1 Parent(s): bf9899b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,7 +41,7 @@ GPT-J 6B was pretrained on the [Pile](pile.eleuther.ai), a large scale curated d
41
 
42
  ## Training procedure
43
 
44
- Genji-python-6B is trained for 20k steps on around 655 million tokens. For LR we used a warmup steps of 2000 and annual decrease of learning rate from 5e-06 to 1e-06.
45
 
46
  ## Intended Use
47
 
@@ -94,7 +94,7 @@ Generation:
94
  ```
95
 
96
  For example usage, you can see our colab notebook as well:
97
- [Notebook]()
98
 
99
  ## Eval results
100
 
 
41
 
42
  ## Training procedure
43
 
44
+ Genji-python-6B is trained for 20k steps on around 655 million tokens with learning rate of 2e-06
45
 
46
  ## Intended Use
47
 
 
94
  ```
95
 
96
  For example usage, you can see our colab notebook as well:
97
+ [Notebook](https://colab.research.google.com/drive/1PnWpx02IEUkY8jhLKd_NewUGEXahAska?usp=sharing)
98
 
99
  ## Eval results
100