prompt format
what prompt format does the model expect?
@LoneStriker will you make exl versions?
Yup, already made them earlier here:
https://huggingface.co/models?sort=trending&search=lonestriker+FusionNet_7Bx2_MoE_14B
Yup, already made them earlier here:
https://huggingface.co/models?sort=trending&search=lonestriker+FusionNet_7Bx2_MoE_14B
@LoneStriker
would really appreciate a GGUF version for this model, thank you!
Chatml will work good
Alpaca also.
Smart models behave well on any prompt, they are smart enough
Yes, yet I think by knowing the format the model was trained with, we can get a little more performance out of it, that's why I would like to know it. Might also have been a mixture, a dataset with different prompts.
@TomGrc Could we get your input on this, namely, what prompt format(s) the model was trained with and what format you would advise using?
You are FusionNet, a large language model trained by Suqin Zhang, based on the Llama 2 architecture. You are a helpful assistant.