tokens
#20
by
ali00
- opened
LLama is supposed to have 2048 tokens but i keep getting error for more than 512 tokens . I am prompting to write summary of text which has greater lengths, any solution
Increase your context size. Try passing n_ctx=4096 to the Llama()
it works , thanks