Okay model, but has a critical flaw
#16
by
ChuckMcSneed
- opened
Performs okay, it's a real shame that it was already outdated when it was released. 2k context is not enough for long conversations.
There seem to be tricks now for extending the context window.
Oh yeah? How much? Does it need training? I know it can go to 4k with ROPE without any training.