Amazing!
I rarely run 70B+ models because the generation speed really upsets me on my equipment (2xP40), but I give it credit, this is the smartest model I’ve ever run on my PC! I had to run Q3, but the model still impressed me. She was not able to solve all the complex riddles that I use to test models, but nevertheless I was impressed by her communication and logical thinking! Surprisingly, she speaks Russian fluently without any errors in grammar. I tried to parse my script with her, she quite successfully corrected it for me and it run without errors. She summarized the text very well under complex instructions; other models did not follow some tasks in the instructions. I provided her with access to the Internet, and during the dialogue, the model herself made a decision when to apply for a search and, based on the information received, gave high-quality answers on the topic. This is truly a new level in the experience of interacting with a neural network for me, thank you for your wonderful work!
That's great feedback, thank you.