shanearora
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -21,14 +21,14 @@ The core models released in this batch include the following:
|
|
21 |
|
22 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
23 |
|------|--------|---------|-------------|-----------------|----------------|
|
24 |
-
| [OLMo 2
|
25 |
-
| [OLMo 2
|
26 |
|
27 |
The core models released in this batch include the following:
|
28 |
|
29 |
| **Stage** | **OLMo 2 7B** | **OLMo 2 13B** |
|
30 |
|----------------------|----------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------|
|
31 |
-
| **Base Model** | [allenai/OLMo-2-7B
|
32 |
| **SFT** | [allenai/OLMo-2-1124-7B-SFT](https://huggingface.co/allenai/OLMo-2-1124-7B-SFT) | [allenai/OLMo-2-1124-13B-SFT](https://huggingface.co/allenai/OLMo-2-1124-13B-SFT) |
|
33 |
| **DPO** | [allenai/OLMo-2-1124-7B-DPO](https://huggingface.co/allenai/OLMo-2-1124-7B-DPO) | [allenai/OLMo-2-1124-13B-DPO](https://huggingface.co/allenai/OLMo-2-1124-13B-DPO) |
|
34 |
| **Final Models (RLVR)** | [allenai/OLMo-2-1124-7B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct) | [allenai/OLMo-2-1124-13B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-13B-Instruct) |
|
|
|
21 |
|
22 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
23 |
|------|--------|---------|-------------|-----------------|----------------|
|
24 |
+
| [OLMo 2 7B](https://huggingface.co/allenai/OLMo-2-1124-7B) | 4 Trillion | 32 | 4096 | 32 | 4096 |
|
25 |
+
| [OLMo 2 13B](https://huggingface.co/allenai/OLMo-2-1124-13B) | 5 Trillion | 40 | 5120 | 42 | 4096 |
|
26 |
|
27 |
The core models released in this batch include the following:
|
28 |
|
29 |
| **Stage** | **OLMo 2 7B** | **OLMo 2 13B** |
|
30 |
|----------------------|----------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------|
|
31 |
+
| **Base Model** | [allenai/OLMo-2-1124-7B](https://huggingface.co/allenai/OLMo-2-1124-7B) | [allenai/OLMo-2-1124-13B](https://huggingface.co/allenai/OLMo-2-1124-13B) |
|
32 |
| **SFT** | [allenai/OLMo-2-1124-7B-SFT](https://huggingface.co/allenai/OLMo-2-1124-7B-SFT) | [allenai/OLMo-2-1124-13B-SFT](https://huggingface.co/allenai/OLMo-2-1124-13B-SFT) |
|
33 |
| **DPO** | [allenai/OLMo-2-1124-7B-DPO](https://huggingface.co/allenai/OLMo-2-1124-7B-DPO) | [allenai/OLMo-2-1124-13B-DPO](https://huggingface.co/allenai/OLMo-2-1124-13B-DPO) |
|
34 |
| **Final Models (RLVR)** | [allenai/OLMo-2-1124-7B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct) | [allenai/OLMo-2-1124-13B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-13B-Instruct) |
|