Update tokenizer_config.json

by saattrupdan - opened Jan 23

←

Jan 23

This uses the tokenizer config from NeuralBeagle, with updated model_max_length to Mistral's 32,768 context length.

saattrupdan changed pull request status to closed Jan 27

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment