Hugging Face's logo

turboderp
/
Llama-3-70B-exl2

Model card Files Community
1

Produces garbage

#1
by catid - opened
Discussion
catid
•
edited Apr 22

This model produces garbage, so I think the quant failed for some reason.

This other one works better: https://huggingface.co/LoneStriker/Meta-Llama-3-70B-Instruct-4.0bpw-h6-exl2/
But you have to edit the generation_config.json as described here to fix it: https://huggingface.co/LoneStriker/Meta-Llama-3-70B-Instruct-4.0bpw-h6-exl2/discussions/1

turboderp
 Owner

This the base model. If you're trying to use if for Instruct, you'll have a bad time. Try this instead.

The generation_config.json has already been updated.

randomtask2000

Please ignore this model- it's utter bollocks

Doctor-Shotgun

image.png

Sign up or log in to comment