can't deploy it in AWS with permission error
#105
by
JeffJay
- opened
Access to model mistralai/Mistral-7B-Instruct-v0.2 is restricted and you are not in the authorized list. Visit https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 to ask for access.
I already included the HF token when deploying.
Please also accepts the terms and conditions in the 'Homepage' of the model.
In addition, try passing the token also into the AutoTokenizer, not only on AutoModelForCausalLM:
AutoTokenizer.from_pretrained(model_id, token = '<your token>')
AutoModelForCausalLM.from_pretrained(model_id, token = '<your token>')
JeffJay
changed discussion status to
closed