Transformers
GGUF
English
tinyllama

The model doesn't generate output

#2
by HR1777 - opened

I follow the provided prompt template (Zephyr) but it only generates "<|system|>" in the output. Whats wrong with this model? How should i fic it?

Please review this article on how to ask questions in a way that people can give you answers: http://www.catb.org/%7Eesr/faqs/smart-questions.html

Please include more information about how you are running the inference. What tool are you using?

Sign up or log in to comment