Great model
#1
by
smchapman54
- opened
Its very good at creating stories, I've found that it's best to use the chatml template. Can fit in 24GB of vram with TTS enabled, Q6_K and 7k context.
Its very good at creating stories, I've found that it's best to use the chatml template. Can fit in 24GB of vram with TTS enabled, Q6_K and 7k context.
Thanks for the feedback! This was very experimental so nice to hear!
Its very good at creating stories, I've found that it's best to use the chatml template. Can fit in 24GB of vram with TTS enabled, Q6_K and 7k context.
Good to know. @fernandofernandes and I spent a long time on this one, and I’m glad it turned out as well as it did.