Update README.md
Browse files
README.md
CHANGED
|
@@ -155,9 +155,6 @@ Below are comparisions of this model with other models in the 7B regime.
|
|
| 155 |
| Falcon | 7B | 1T | ✓ | 44.1 | 27.4 | 25.1 |
|
| 156 |
| OLMo-1.7 | 7B | 2.1T | ✓ | 47.0 | 54.0 | 34.2 |
|
| 157 |
| MAP-Neo | 7B | 4.5T | ✓ | **50.2** | **57.1** | **40.4** |
|
| 158 |
-
| **Models we trained** | | | | | | |
|
| 159 |
-
| FineWeb edu | 7B | 0.14T | ✓ | 38.7 | 26.3 | 22.1 |
|
| 160 |
-
| FineWeb edu | 7B | 0.28T | ✓ | 41.9 | 37.3 | 24.5 |
|
| 161 |
| **DCLM-7B-8k** | 7B | 2.5T | ✓ | **57.1** | **63.7** | **45.4** |
|
| 162 |
|
| 163 |
|
|
|
|
| 155 |
| Falcon | 7B | 1T | ✓ | 44.1 | 27.4 | 25.1 |
|
| 156 |
| OLMo-1.7 | 7B | 2.1T | ✓ | 47.0 | 54.0 | 34.2 |
|
| 157 |
| MAP-Neo | 7B | 4.5T | ✓ | **50.2** | **57.1** | **40.4** |
|
|
|
|
|
|
|
|
|
|
| 158 |
| **DCLM-7B-8k** | 7B | 2.5T | ✓ | **57.1** | **63.7** | **45.4** |
|
| 159 |
|
| 160 |
|