The bot can't differentiate between commenting the situation or talking to the bot
Example:
Me: I eat a popcorn while we watch the movie
Bot: Sure you can eat a popcorn while we watch the movie
I mean it is not a big problem, just providing feedback. The model and colab works very well! I hope you will improve it more. Thank you for your work.
add * to the start and end without spcaes. This seems to work every time i've used it in testing, and again beat out OPT on recognizing the YOUR TEXT HERE PLS as an action.
I eat popcorn this tastes great.
Tried it. Sometimes it works yeah thanks. The later part of your sentence i dont understand. Is it an configuration option in the gradio app?
Oh, sorry. I haven't used anything from them other than the models themselves. In the software I wrote using that format works well and I'm not sure why it would be changed, since it's still the same model.
Here's what I meant. Huggingface makes the * into italics so here's a screenshot.
Thank you! One more question please. Is it possible to deal with the very short term memory of the model? It only remembers 2-3 lines for me. Is it a hardware thing or the model needs more training?
I'm not sure what you mean by that, it depends more on the software you're using for inference on the model. Look up kobold AI, it's another software that lets you run this and other models with much better chat features and access to a bunch of settings. The defaults work best with this model but you can still play around with them. It also lets you give the model context up to 2056 tokens (it can go higher but don't because it WILL collapse) which is around 2,010 words. That let's it hold context for a few paragraphs, and it also supports residual memory so it can store core details in permanent memory.
Yeah it was the GUI i used was bad... With koboldai and tavern ai the model can remember more things