chat template?
#1
by
aaha
- opened
Hi!
What chat template should be used? I saw in the original model that it was randomly generating gibberish making it unusable. Do you think this could be due to a template issue? Given it scores so high i'd like to give this a try, but want to make sure i am using it right. Thanks again for amazing job helping the community with ggufs
@MaziyarPanahi
!
btw, there is this amazing model with very high MMLU from causalLM CausalLM/34b-beta. Can you share gguf for that? Thanks again!
Hi
@aaha
I will look into this model, in the meantime this the GGUF of that 34B model: https://huggingface.co/MaziyarPanahi/34b-beta-GGUF
Any word on the chat template?
Any word on the chat template?
The chat template is alpaca, such as:
Instruction:
{instruction}