How to use the model section in model card.
#4
by
sudhir2016
- opened
This looks incorrect. There is no option to load meta-llama/Llama-2-7b-hf in 4bits. Please suggest.
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf", load_in_4bit=True)