Update README.md

README.md

@@ -91,7 +91,7 @@ print(tokenizer.decode(outputs[0]))
 
 ## Training Data
 
-Falcon-Mamba has been trained with ~ 6,000 GT mainly coming from [Refined-Web](https://huggingface.co/datasets/tiiuae/falcon-refinedweb), a large volume web-only dataset filtered and deduplicated.
+Falcon-Mamba has been trained with ~ 5,500 GT mainly coming from [Refined-Web](https://huggingface.co/datasets/tiiuae/falcon-refinedweb), a large volume web-only dataset filtered and deduplicated.
 Similar to the others [Falcon](https://huggingface.co/tiiuae/falcon-11B) suite models, Falcon-Mamba has been trained leveraging a multi-stage training strategy to increase the context-length training from 2,048 up to 8,192. 
 Note that at inference the context-length is not relevant as the Mamba architecture has no limit on long range dependency.
 At the last training stage, small portion of high-quality curated data was used to further enhance performance.