settings
would it be possible to see the settings you are using for this model for some reason i just get gibberish or a complete breakdown
It's not just you, the model totally breaks down for me at higher context, and doesn't seem to like prompting beyond a very strict chat format.
ahh thanks for the reply I thought I was doing something incorrect, I noticed a breakdown at high context as well.
also your v5 merge is my go to so far been playing with 68k-100k context at 4bpw for detailed story/RP, great job.
Thanks! In fact I actually made a v6 locally that I am not satisfied with. I am going to upload a v7 probably this weekend, then try a Vicuna-focused merge along the lines of this discussion:
oh now, thats awesome ill keep a look out for both and provide feedback.
Agreed that V5 is still one of the most if not the most incredible model I've experienced