Update README.md

README.md

@@ -62,7 +62,7 @@ Apache-2.0 (commercial use permitted)
 
 ## Documentation
 
-* [Blog post: Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs](www.mosaicml.com/blog/mpt-7b)
+* [Blog post: Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs](https://www.mosaicml.com/blog/mpt-7b)
 * [Codebase (mosaicml/llm-foundry repo)](https://github.com/mosaicml/llm-foundry/)
 * Questions: Feel free to contact us via the [MosaicML Community Slack](https://join.slack.com/t/mosaicml-community/shared_invite/zt-w0tiddn9-WGTlRpfjcO9J5jyrMub1dg)!
 
@@ -140,14 +140,14 @@ The model was trained for 1T tokens (with batch size 1760 and sequence length 20
 | Data Source | Number of Tokens in Source | Proportion | Effective Number of Tokens | Epochs |
 |-------------|----------------------------|------------|----------------------------|--------|
 | mC4 3.1.0 - English | 417.99 B | 0.33 | 330 B | 0.14 |
-| C4 - English - SemDedup 80% | 100.42 B | 0.299 | 299 B | 2.98 |
+| C4 - English - SemDedup 80% | 100.42 B | 0.294 | 294 B | 2.93 |
 | RedPajama - CommonCrawl | 878.45 B | 0.1 | 100 B | 0.11 |
 | The Stack - Selected Languages | 463.78 B | 0.1 | 100 B | 0.22 |
-| RedPajama - Wikipedia | 24.84 B | 0.04 | 40 B | 1.61 |
+| RedPajama - Wikipedia - En | 4.87 B | 0.04 | 40 B | 8.21 |
 | The Stack - Markdown | 107.07 B | 0.035 | 35 B | 0.33 |
-| S2ORC | 48.85 B | 0.033 | 33 B | 0.68 |
-| RedPajama - Books | 26.02 B | 0.03 | 30 B | 1.15 |
-| RedPajama - arXiv | 28.10 B | 0.019 | 19 B | 0.04 |
+| S2ORC | 48.85 B | 0.035 | 35 B | 0.72 |
+| RedPajama - Books | 26.02 B | 0.033 | 33B | 1.27 |
+| RedPajama - arXiv | 28.10 B | 0.019 | 19 B | 0.68 |
 | RedPajama - StackExchange | 20.54 B | 0.014 | 14 B |0.68 |
 
 Samples for each batch were selected from one of the datasets with the probability specified above.