Wow...
I tried many Llama3 finetunes for RP this week, and this one is something else. Unhinged, but in a good way. Characters behave as if they have their own opinions; they argue with me sometimes, talk with each other more, and I see small notes of sarcasm in some of their spoken lines. Narration is very good and has so far never repeated itself during my 50-ish message-long RP sequence (what I mean is that many other L3 models latch on to patterns in their own descriptive text and then repeat it with minimal modification in subsequent replies). This model seems to be very horny by default, and I had to specifically instruct it to avoid sexual themes.
Thank you for your feedback! The base model itself is pretty good at following instructions, so when it merged with the story LORA from Blackroot, it seems that the model became a storytelling instruction model. However, based on the other feedback, it might not be the best at 1-on-1 RP due to its storytelling tendencies. I'm glad if you like my model!
Also, damn that is a very long message! What context size did you use? I never test the model longer than 4k context. How does the model behave for longer context?
Ah, I'm opposite - always set it to 16k for all Llama 3 based models.