Different base model suggestion.
#1
by
TheBlock
- opened
Perhaps you should use StableLM Zephyr 1.6B instead of TinyLlama as its more coherent and smarter by default. just a suggestion, thank you for your models.
Very true and thank you. I've been busy working on other stuff recently, but I'll be back to fine-tuning soon.
Thanks! just thought that would be better!
TheBlock
changed discussion status to
closed