Update README.md

README.md

@@ -99,7 +99,7 @@ model = transformers.AutoModelForCausalLM.from_pretrained(
 )
 ```
 
-The model was trained initially with a sequence length of 4096 with an additional pretraining stage for sequence length adapation up to 8192. However, ALiBi enables users to increase the maximum sequence length even further during finetuning and/or inference. For example:
+The model was trained initially with a sequence length of 2048 with an additional pretraining stage for sequence length adapation up to 8192. However, ALiBi enables users to increase the maximum sequence length even further during finetuning and/or inference. For example:
 
 ```python
 import transformers