Update README.md
Browse files
README.md
CHANGED
@@ -45,7 +45,7 @@ are models further trained by additional (potentially) high-quality 27B tokens d
|
|
45 |
## Model Details
|
46 |
|
47 |
- **Model type:** Transformer-based Language Model
|
48 |
-
- **Total seen tokens:**
|
49 |
|
50 |
|Model|Params|Layers|Hidden size|Heads|Context length|
|
51 |
|:---:|:---:|:---:|:---:|:---:|:---:|
|
|
|
45 |
## Model Details
|
46 |
|
47 |
- **Model type:** Transformer-based Language Model
|
48 |
+
- **Total seen tokens:** 300B
|
49 |
|
50 |
|Model|Params|Layers|Hidden size|Heads|Context length|
|
51 |
|:---:|:---:|:---:|:---:|:---:|:---:|
|