This quantized Llama3 cannot answer in different language like original Meta Llama3 model
#16
by
taiSupermicro
- opened
Llama 3 can answer in different languages while Llama2 will understand different language but still answer in English. It turned out that, this model card is still answering in English. So I wonder what happen after quantized the original model from Meta ?
taiSupermicro
changed discussion title from
Is this truly quantized Llama3 or Llama2 ?
to This quantized Llama3 cannot answer in different language liek original Meta Llama3 model
taiSupermicro
changed discussion title from
This quantized Llama3 cannot answer in different language liek original Meta Llama3 model
to This quantized Llama3 cannot answer in different language like original Meta Llama3 model
taiSupermicro
changed discussion status to
closed
taiSupermicro
changed discussion status to
open
Can you try if this works https://huggingface.co/QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2