Incredible
#1
by
dbeltrandigital
- opened
This is the best model for reviewing prose in writing that I've ever seen. It is spectacular. I would love to see an 8K version.
I honestly thought my model was kinda borked when i tested it, but im glad some people still like it.
About an 8k version, you can easily achive 8k+(can go up to 16k i think?) with RoPE scaling.
Lemme know if you have any other suggestions or questions :)
Cool, I'll check that out. The model does seem to get confused as you get deep into it, so maybe extending the context might help. Thanks!
dbeltrandigital
changed discussion status to
closed
athena v2 is out btw