INST issue and instuction following

#2
by Solsboer - opened

I tested the GGUF version and found that the model is very poorly following instructions of small complexity. Here is my example:

image.png

Also I noticed that it mostly fails after the model gives a proper response but then INST appears and everything becomes chaotic (this is also what we can see in the example).

For a very simple or default system prompts model behavior is pretty ok. I hope maybe this will help to improve the model. Good luck

bards.ai org

Thanks a lot for your feedback. We are trying to improve model performance :D

Sign up or log in to comment