Llama3 8b related model has bursting issues when it generates emotion-related words
#95
by
HyperBlaze
- opened
After testing Roleplay-like character imitating with llama3 models, I've found out that almost any model, including this official instruct model all have 'exploding' issues when it generates emotion related words.
The temperature and repeat penalty was both low.
Such as this: "I am happy glad fulfill desire love like...(until token limit reaches)"
I am no expert in LLMs, but this issue seems quite happens often when I use the model for these purposes.
This may be the prompt's issue, but anyway I opened discussion for this.
Anybody that has similar issue, please comment if this issue is quite persistent or not