What's the context window on Orenguteng/Llama-3-8B-Lexi-Uncensored-GGUF?

#4
by askyforever - opened

Hi Orenguteng,

Just wondering what's the context window on this, sorry if noob question. I was thinking originally context window is set by the foundational model, but now starting to see and think it is dependent on the tuned version.

I'm deploying this model as something like continuing a story. I think I got lucky on my first shot and it remembered alot of things, but 10 runs in a row after so far, it forgets everything with the same base story given and system prompt.

Thanks

@askyforever The context window is as the original 8k, I'm experimenting longer context windows atm

Thanks that would be very nice to have!

askyforever changed discussion status to closed

Sign up or log in to comment