Hugging Face's logo

mlabonne
/
NeuralHermes-2.5-Mistral-7B

Text Generation
Transformers
Safetensors
English
mistral
instruct
finetune
chatml
gpt4
synthetic data
distillation
dpo
rlhf
conversational
Eval Results
text-generation-inference
Model card Files Community
10

Context length

#1
by mrfakename - opened
Discussion
mrfakename

What’s the context length?

mlabonne
 Owner

8k, with a theoretical attention span of 128K tokens (from Mistral-7b)

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment