Thank you so much!
It is an excellent model, and thanks to you I can use it on my PC. I have tested it in a reasoning test, and so far, it demonstrates excellent capabilities. It has sorprised me for good.
+1
Seems like everyone was having the issue with the model output not stopping correctly lol
+1
Seems like everyone was having the issue with the model output not stopping correctly lol
I just tested it in the new lm Studio update, and it works perfectly. At first I also got that same error.
Can confirm that the new LM Studio update fixed this one. Make sure to use the Llama 3 template.
+1
Seems like everyone was having the issue with the model output not stopping correctly lol
still have this issue with llama-cpp-python library model is not stoppng seems to be problem with stop tokens