max_new_tokens and context_length
#7
by
farazashraf
- opened
what is the max token and context length of this model? Can't we add this parameters in ctransformers. Does ctransformer support max token and context length of mistral?
It is 32k, set ctx according to your resources.
MaziyarPanahi
changed discussion status to
closed