problem, he repeats
#2
by
ClaudioItaly
- opened
He replies in a long way using ChatLM but there is a problem, he repeats the same thing without stopping. I think some checks need to be done
It looks like you can replace some files with corrected ones and re-quant to get a working model.
https://huggingface.co/ChaoticNeutrals/Llama3-Corrections/tree/main
Checkout also here for solutions: https://huggingface.co/dreamgen/opus-v1.2-llama-3-8b/discussions/3