Great model!

#1
by dillfrescott - opened

Really liking it so far! Thank you!

+1 to the positive comments. I've been experimenting with 70b model merges for enhancing storytelling/roleplaying capabilities, and this 34b model is producing results of a similar caliber right out of the gate. Very impressive!
Everyone working with 24 GB of VRAM or less should rejoice. This is the model you want to use!

I’m still iterating, so bear with me. This is great for creative work, but lags state of the art in reasoning.
STEM focused model is coming!

Can't wait for that one! Yay!

Very nice. Thank you! +1 for the STEM focused one too.

I have had the following issues with it:

  • Characters replying in only a few words sometimes, without any attempt at continuing the storyline, this model needs more "pushing" than others I have used.
  • When it doesn't know something, it gives up. For example with this usecase:
    Prompt: What are some interesting ways to change up the adventure Curse of Strahd? Summarize in one paragraph.
    Response: Here's a summary of some interesting ways to change up the adventure Curse of Strahd:

Understood, thanks for the feedback. A new version is training which will deprecate this.

migtissera changed discussion status to closed

Sign up or log in to comment