Update README.md

README.md

@@ -100,7 +100,7 @@ print(tokenizer.batch_decode(outputs))
 
 We trained SN-13B-8k-Instruct with [SambaNova DataScale systems](https://sambanova.ai/products/datascale/) with
 SambaNova's in-house Reconfigurable Dataflow Unit (RDU). We started from random weights, and pretrained for 300 Billion
-tokens on sequences of size 2048.  We then pretrained for another 500 Billion tokens on sequences of size 8192.
+tokens on sequences of size 2048.  We then pretrained for another 250 Billion tokens on sequences of size 8192.
 During this phase of training, we curated a dataset that had a large proportion of long sequence articles, with
 30% of our articles consisting of greater than 6000 words.