Fix seq_length to align with the BLOOM paper

#7

There is an inconsistency between the paper (https://arxiv.org/pdf/2211.05100) and the config for this model.
Page 21, Table 3 : Sequence length is 2048 not 4096.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment