fix max_position_embeddings 128Ki --> 256Ki
#11
by ddh0 - opened
The model card and blog post both say the model supports 256Ki tokens. The config did not reflect this. This PR changes the max_position_embeddings in the config.json from 131072 to 262144.
Thanks! This is now fixed.
osanseviero changed pull request status to closed