Specify maximum context length in config

#40

by saattrupdan - opened 18 days ago

18 days ago

The configuration parameter max_position_embeddings seems to be missing, and I don't see any other parameter in the configuration or the tokenizer configuration that indicates the maximum context length of 128,000. This information is automatically pulled in the EuroEval evaluation framework, so would be great if it could be added.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment