prompt format?
#2
by
gblazex
- opened
I get only nonsense in LM Studio. What is the prompt format?
The prompt format is alpaca. How did you quantize the model?
Hey I saw it from here : https://huggingface.co/s3nh/Tensoic-TinyLlama-1.1B-3T-openhermes-GGUF
It gives nonsense in ollama, saw the issue open so figured ill post it here.
oh yes, I was using same quant, so that's the issue.
Hmm might be. I'm not very optimistic of this model. Tiny Llama that is.
I agree the base model has been underwhelming in my tests.
That’s why I’ve been looking at fine tunes and variants to make sure I get a clear picture